Jul 01 17:37:04.543621 ip-10-0-143-173 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 17:37:04.543632 ip-10-0-143-173 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 17:37:04.543639 ip-10-0-143-173 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 17:37:04.543851 ip-10-0-143-173 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 17:37:14.561523 ip-10-0-143-173 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 17:37:14.561536 ip-10-0-143-173 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5c27481910c547f5bdd674ed29bcfa3a -- Jul 01 17:38:59.897505 ip-10-0-143-173 systemd[1]: Starting Kubernetes Kubelet... Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.291400 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296068 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296079 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296084 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296087 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296091 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296094 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296097 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.297894 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296099 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296102 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296105 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296108 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296111 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296114 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296116 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296120 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296122 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296125 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296131 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296134 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296137 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296139 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296142 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296144 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296147 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296150 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296153 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296155 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.299580 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296158 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296161 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296163 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296166 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296168 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296171 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296173 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296176 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296178 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296181 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296184 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296187 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296189 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296192 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296195 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296197 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296200 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296203 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296205 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296208 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.300223 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296210 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296213 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296215 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296220 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296224 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296227 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296230 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296234 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296237 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296242 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296245 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296248 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296251 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296254 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296257 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296259 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296261 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296264 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296266 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.301706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296269 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296271 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296274 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296276 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296279 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296282 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296285 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296287 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296289 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296293 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296296 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296298 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296300 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296303 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296305 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296307 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296310 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296312 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296315 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296317 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.302354 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296320 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296322 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296327 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296330 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296332 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296334 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296337 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296339 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296342 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296344 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296347 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296351 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.296354 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297070 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297077 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297081 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297084 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297087 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297092 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.304249 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297095 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297099 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297101 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297104 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297107 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297109 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297112 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297114 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297117 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297120 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297123 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297125 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297128 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297130 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297133 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297136 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297138 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297141 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297144 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297147 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.304888 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297150 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297152 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297155 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297157 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297160 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297162 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297164 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297167 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297170 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297172 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297175 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297177 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297180 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297183 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297185 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297188 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297190 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297193 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297196 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297198 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.310201 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297202 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297206 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297208 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297211 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297213 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297215 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297218 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297220 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297223 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297225 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297228 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297231 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297233 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297236 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297238 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297241 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297244 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297246 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297249 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297251 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.311288 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297254 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297256 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297261 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297264 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297268 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297271 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297274 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297277 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297279 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297282 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297285 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297287 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297290 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297293 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297296 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297299 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297301 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297304 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297307 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297309 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.313235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297312 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297315 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297317 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297320 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297322 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297326 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297330 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297333 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297335 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297338 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297341 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297343 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297345 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297711 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297715 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297718 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297721 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297724 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297726 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297729 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.313883 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297731 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297734 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297736 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297739 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297742 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297744 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297747 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297750 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297752 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297755 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297758 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297760 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297763 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297766 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297769 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297771 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297774 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297776 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297779 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.316712 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297781 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297784 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297786 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297789 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297791 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297794 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297796 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297799 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297801 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297804 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297807 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297810 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297813 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297815 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297818 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297820 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297824 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297828 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297834 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.317558 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297838 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297841 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297844 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297847 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297850 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297853 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297855 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297858 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297860 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297863 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297867 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297871 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297874 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297877 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297879 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297882 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297885 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297888 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297890 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297893 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.320351 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297896 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297899 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297902 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297904 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297907 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297910 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297913 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297916 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297918 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297921 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297923 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297926 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297929 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297931 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297949 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297974 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297990 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297995 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.297998 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298002 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.321503 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298005 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298009 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298011 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298014 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298017 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298020 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298024 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298027 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298029 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298034 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298037 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298040 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298043 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298046 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298117 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298124 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298131 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298136 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298140 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298144 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 17:39:00.326902 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298148 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298152 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298156 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298159 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298163 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298166 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298169 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298172 2582 flags.go:64] FLAG: --cgroup-root="" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298176 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298179 2582 flags.go:64] FLAG: --client-ca-file="" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298182 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298185 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298189 2582 flags.go:64] FLAG: --cluster-domain="" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298192 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298195 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298198 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298202 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298205 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298208 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298211 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298214 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298218 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298221 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298224 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 17:39:00.327848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298227 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298230 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298234 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298237 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298240 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298243 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298246 2582 flags.go:64] FLAG: --enable-server="true" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298248 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298254 2582 flags.go:64] FLAG: --event-burst="100" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298261 2582 flags.go:64] FLAG: --event-qps="50" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298264 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298267 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298270 2582 flags.go:64] FLAG: --eviction-hard="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298273 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298277 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298280 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298283 2582 flags.go:64] FLAG: --eviction-soft="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298286 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298289 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298292 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298295 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298298 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298301 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298304 2582 flags.go:64] FLAG: --feature-gates="" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298307 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 17:39:00.386746 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298310 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 17:39:00.369073 ip-10-0-143-173 systemd[1]: Started Kubernetes Kubelet. Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298313 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298316 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298319 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298323 2582 flags.go:64] FLAG: --help="false" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298326 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298329 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298331 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298334 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298338 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298341 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298344 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298347 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298350 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298353 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298355 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298360 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298363 2582 flags.go:64] FLAG: --kube-reserved="" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298366 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298369 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298372 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298376 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298379 2582 flags.go:64] FLAG: --lock-file="" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298382 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 17:39:00.388390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298385 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298388 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298395 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298397 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298400 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298403 2582 flags.go:64] FLAG: --logging-format="text" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298406 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298409 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298412 2582 flags.go:64] FLAG: --manifest-url="" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298415 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298419 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298422 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298426 2582 flags.go:64] FLAG: --max-pods="110" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298429 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298432 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298435 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298438 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298441 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298444 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298447 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298454 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298457 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298460 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 17:39:00.391854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298463 2582 flags.go:64] FLAG: --pod-cidr="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298467 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298477 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298480 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298483 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298487 2582 flags.go:64] FLAG: --port="10250" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298491 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298494 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc7d1130f5ae03bd" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298497 2582 flags.go:64] FLAG: --qos-reserved="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298500 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298503 2582 flags.go:64] FLAG: --register-node="true" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298507 2582 flags.go:64] FLAG: --register-with-taints="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298511 2582 flags.go:64] FLAG: --registry-burst="10" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298514 2582 flags.go:64] FLAG: --registry-qps="5" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298517 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298520 2582 flags.go:64] FLAG: --reserved-memory="" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298523 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298526 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298529 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298532 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298542 2582 flags.go:64] FLAG: --runonce="false" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298545 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298549 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298552 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298554 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 17:39:00.393008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298557 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298560 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298563 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298567 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298570 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298572 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298575 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298578 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298581 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298585 2582 flags.go:64] FLAG: --system-cgroups="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298588 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298595 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298598 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298602 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298606 2582 flags.go:64] FLAG: --tls-min-version="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298609 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298611 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298614 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298617 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298622 2582 flags.go:64] FLAG: --v="2" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298626 2582 flags.go:64] FLAG: --version="false" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298630 2582 flags.go:64] FLAG: --vmodule="" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298634 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.298637 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298755 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.396706 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298759 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298762 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298766 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298769 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298771 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298774 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298776 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298779 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298781 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298784 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298786 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298789 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298792 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298794 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298797 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298799 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298803 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298806 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298809 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298811 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.397817 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298815 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298818 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298821 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298824 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298826 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298829 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298841 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298844 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298847 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298850 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298852 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298855 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298857 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298860 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298863 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298866 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298868 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298871 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298873 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298876 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.400573 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298878 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298881 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298884 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298886 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298889 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298891 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298894 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298896 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298900 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298903 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298907 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298911 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298916 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298919 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298922 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298929 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298932 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298951 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298955 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.401491 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298958 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298962 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298965 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298967 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298970 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298973 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298976 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298978 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298981 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298984 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298986 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298989 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298992 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298994 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298997 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.298999 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299002 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299005 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299007 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299010 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.403793 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299012 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299017 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299020 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299023 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299025 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299030 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299033 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299037 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299040 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299043 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299046 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299050 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299054 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299056 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299059 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299062 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299065 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299068 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.404559 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.299070 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.299075 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.306966 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.306982 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.307001 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.307011 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307067 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307073 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307076 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307079 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307083 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307086 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307089 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307091 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.410656 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307094 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307097 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307099 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307103 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307105 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307108 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307110 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307113 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307116 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307118 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307121 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307124 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307127 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307129 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307132 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307135 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307137 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307141 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307144 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307146 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.412052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307149 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307152 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307155 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307158 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307160 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307163 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307165 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307168 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307172 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307176 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307178 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307181 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307184 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307186 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307189 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307191 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307194 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307197 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307199 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.416554 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307202 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307205 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307207 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307210 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307213 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307215 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307218 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307221 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307223 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307225 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307228 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307231 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307234 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307237 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307239 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307242 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307245 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307247 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307250 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307252 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.417737 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307256 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307259 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307263 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307265 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307268 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307271 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307274 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307277 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307279 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307282 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307284 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307287 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307290 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307293 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307296 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307298 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307301 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307304 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307306 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307309 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.418705 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307312 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307314 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307317 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307320 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307322 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307325 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307328 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307331 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307335 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307339 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307342 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307344 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.307349 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307460 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307464 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:39:00.427684 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307467 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307470 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307473 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307476 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307479 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307482 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307485 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307487 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307490 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307492 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307495 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307498 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307501 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307505 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307508 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307511 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307513 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307516 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307518 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:39:00.428342 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307521 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307523 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307526 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307529 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307531 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307534 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307538 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307541 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307544 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307547 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307550 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307552 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307556 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307559 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307561 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307564 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307566 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307569 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307572 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307574 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:39:00.429262 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307577 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307579 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307581 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307584 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307587 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307590 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307592 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307595 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307597 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307601 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307604 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307608 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307610 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307613 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307616 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307619 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307622 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307625 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307627 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:39:00.431540 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307629 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307632 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307635 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307637 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307640 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307643 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307645 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307649 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307651 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307654 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307656 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307659 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307661 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307664 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307667 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307670 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307672 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307674 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307677 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:39:00.432450 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307680 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307682 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307685 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307687 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307690 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307693 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307695 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307698 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307701 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307704 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307706 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307709 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307711 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307716 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307719 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307722 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307724 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307727 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307730 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:39:00.503635 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:00.307732 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.307737 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.307861 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.310694 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.312614 2582 server.go:1019] "Starting client certificate rotation" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.312709 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.312745 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.314910 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.321287 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.334621 2582 log.go:25] "Validated CRI v1 runtime API" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.336795 2582 log.go:25] "Validated CRI v1 image API" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.338983 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 17:39:00.504593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.342270 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7eb493fc-cf97-489f-8bcc-fa076ca2c032:/dev/nvme0n1p3 c8f43b29-890c-472e-bab1-4e95b72310a2:/dev/nvme0n1p4] Jul 01 17:39:00.507505 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.342292 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.347950 2582 manager.go:216] Machine: {Timestamp:2026-07-01 17:39:00.346524583 +0000 UTC m=+0.339793769 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100152 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243f85db3213162fc2da31acc2e17a SystemUUID:ec243f85-db32-1316-2fc2-da31acc2e17a BootID:5c274819-10c5-47f5-bdd6-74ed29bcfa3a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:88:e8:c1:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:88:e8:c1:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:6e:be:f8:6c:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.348070 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.348176 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.350983 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.351008 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.351706 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.351716 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 17:39:00.507811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.351724 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.352998 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.353737 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.356388 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.356507 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357192 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357207 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357222 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357231 2582 kubelet.go:398] "Adding apiserver pod source" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357241 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357607 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.357627 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.361942 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363238 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363267 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363424 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363437 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363443 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363448 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363458 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363464 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363940 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363947 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363955 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363961 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363969 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.363978 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.364697 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.364704 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.368211 2582 server.go:1268] "Started kubelet" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.368358 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.368451 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.368491 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.370387 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.372361 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.374332 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.374776 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 17:39:00.581215 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.374776 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.374411 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26cfe80c06 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.368182278 +0000 UTC m=+0.361451463,LastTimestamp:2026-07-01 17:39:00.368182278 +0000 UTC m=+0.361451463,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.377386 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.377398 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.377781 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.377971 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.377976 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.377990 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.379341 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.379355 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.381454 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.381531 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.404869 2582 factory.go:55] Registering systemd factory Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.404885 2582 factory.go:223] Registration of the systemd container factory successfully Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405084 2582 factory.go:153] Registering CRI-O factory Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405097 2582 factory.go:223] Registration of the crio container factory successfully Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405144 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405169 2582 factory.go:103] Registering Raw factory Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405182 2582 manager.go:1196] Started watching for new ooms in manager Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.405557 2582 manager.go:349] Starting recovery of all containers Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.419710 2582 manager.go:354] Recovery completed Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.425166 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.440507 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.440536 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.440550 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.444290 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26d437e58f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-173.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.440524175 +0000 UTC m=+0.433793366,LastTimestamp:2026-07-01 17:39:00.440524175 +0000 UTC m=+0.433793366,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.584213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.456438 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.456456 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.456477 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.456512 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457357 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457392 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457409 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457711 2582 policy_none.go:49] "None policy: Start" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457727 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.457738 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.458512 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26d4382c6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-173.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.440542314 +0000 UTC m=+0.433811501,LastTimestamp:2026-07-01 17:39:00.440542314 +0000 UTC m=+0.433811501,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.458837 2582 policy_none.go:47] "Start" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.468774 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26d43862a7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-173.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.440556199 +0000 UTC m=+0.433825386,LastTimestamp:2026-07-01 17:39:00.440556199 +0000 UTC m=+0.433825386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.477990 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.516706 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.528506 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-173.ec2.internal.18be3b26d437e58f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26d437e58f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-173.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.440524175 +0000 UTC m=+0.433793366,LastTimestamp:2026-07-01 17:39:00.457371964 +0000 UTC m=+0.450641153,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.528609 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzpxw" Jul 01 17:39:00.599245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.528626 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzpxw" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.531956 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-173.ec2.internal.18be3b26d4382c6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-173.ec2.internal.18be3b26d4382c6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-173.ec2.internal,UID:ip-10-0-143-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-173.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-173.ec2.internal,},FirstTimestamp:2026-07-01 17:39:00.440542314 +0000 UTC m=+0.433811501,LastTimestamp:2026-07-01 17:39:00.457400414 +0000 UTC m=+0.450669602,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-173.ec2.internal,}" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553129 2582 manager.go:337] "Starting Device Plugin manager" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.553170 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553185 2582 server.go:87] "Starting device plugin registration server" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553502 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553516 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553687 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553770 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.553779 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.554202 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.554256 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.600943 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.591903 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-173.ec2.internal\" not found" node="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.639208 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.639168 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 17:39:00.640403 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.640390 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 17:39:00.640472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.640422 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 17:39:00.640472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.640450 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 17:39:00.640545 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.640480 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 17:39:00.643661 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.643636 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:00.653874 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.653831 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.654660 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.654644 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.654735 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.654675 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.654735 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.654685 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.654735 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.654708 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.664419 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.664405 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.664467 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.664426 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-173.ec2.internal\": node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.696634 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.696610 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.743277 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.743241 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal"] Jul 01 17:39:00.743372 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.743327 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.744918 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.744899 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.745024 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.744932 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.745024 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.744943 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.746139 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746127 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.746271 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.746331 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746290 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.746914 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746885 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.747043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746927 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.747043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746958 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.747043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.746885 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.747043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.747018 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.747043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.747035 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.748118 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.748102 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.748212 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.748129 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:00.748863 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.748846 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:00.749008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.748871 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:00.749008 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.748881 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:00.772911 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.772881 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-173.ec2.internal\" not found" node="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.777676 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.777655 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-173.ec2.internal\" not found" node="ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.783044 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.783024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.783116 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.783056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.783116 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.783076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d49aadf2d9d721fc3745139ad40d239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-173.ec2.internal\" (UID: \"5d49aadf2d9d721fc3745139ad40d239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.797394 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.797363 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.884021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.883976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.884142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.884026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d49aadf2d9d721fc3745139ad40d239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-173.ec2.internal\" (UID: \"5d49aadf2d9d721fc3745139ad40d239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.884142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.884066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.884142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.884095 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.884142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.884099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33ff0aa068abf04af741b448baaa7956-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal\" (UID: \"33ff0aa068abf04af741b448baaa7956\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.884271 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:00.884146 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d49aadf2d9d721fc3745139ad40d239-config\") pod \"kube-apiserver-proxy-ip-10-0-143-173.ec2.internal\" (UID: \"5d49aadf2d9d721fc3745139ad40d239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:00.898186 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.898155 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:00.998583 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:00.998507 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.081070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.081036 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:01.081070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.081047 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:01.099129 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.099100 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.199765 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.199707 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.288064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.287978 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:01.300888 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.300843 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.311284 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.311255 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 17:39:01.311457 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.311436 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:39:01.311508 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.311450 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 17:39:01.401342 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.401314 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.484947 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.484907 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:39:01.485990 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.485970 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:39:01.486110 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.486001 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:39:01.486110 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.486012 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:39:01.502356 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.502327 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.532815 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.532768 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:34:01 +0000 UTC" deadline="2027-12-26 17:13:44.464345955 +0000 UTC" Jul 01 17:39:01.532906 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.532827 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13031h34m42.931538612s" Jul 01 17:39:01.603032 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.602969 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.703385 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.703189 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.801964 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:01.801908 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ff0aa068abf04af741b448baaa7956.slice/crio-a763a407374fbf22c77b8c7979c1835679d4c1b380afdc76d2d592591f8db89f WatchSource:0}: Error finding container a763a407374fbf22c77b8c7979c1835679d4c1b380afdc76d2d592591f8db89f: Status 404 returned error can't find the container with id a763a407374fbf22c77b8c7979c1835679d4c1b380afdc76d2d592591f8db89f Jul 01 17:39:01.803533 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:01.803502 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d49aadf2d9d721fc3745139ad40d239.slice/crio-445c8e984c65df6393cc07f9edaec7fb37848aa3826d14a642d83896df709d25 WatchSource:0}: Error finding container 445c8e984c65df6393cc07f9edaec7fb37848aa3826d14a642d83896df709d25: Status 404 returned error can't find the container with id 445c8e984c65df6393cc07f9edaec7fb37848aa3826d14a642d83896df709d25 Jul 01 17:39:01.803533 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:01.803508 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-173.ec2.internal\" not found" Jul 01 17:39:01.807514 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.807490 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:39:01.832350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.832322 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:01.842637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.842618 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:01.878397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.878319 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" Jul 01 17:39:01.888428 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.888404 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:39:01.889400 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.889383 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" Jul 01 17:39:01.906079 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:01.906060 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:39:02.361517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.361441 2582 apiserver.go:52] "Watching apiserver" Jul 01 17:39:02.370632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.370607 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 17:39:02.371050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.371027 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-r4mqk","openshift-image-registry/node-ca-qtw7n","openshift-multus/multus-additional-cni-plugins-ptjvf","openshift-multus/multus-xns2r","kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal","openshift-multus/network-metrics-daemon-cvc7c","openshift-network-diagnostics/network-check-target-scssm","openshift-network-operator/iptables-alerter-77mrk","openshift-ovn-kubernetes/ovnkube-node-vpnd8","kube-system/global-pull-secret-syncer-76qms","kube-system/konnectivity-agent-z5bvt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg","openshift-cluster-node-tuning-operator/tuned-g9xl9"] Jul 01 17:39:02.373731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.373708 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.373857 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.373804 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:02.376052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.376029 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.376162 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.376109 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:02.378447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.378304 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 17:39:02.378447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.378425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.380793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.380764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.382320 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.382302 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 17:39:02.382427 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.382391 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 17:39:02.382772 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.382751 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.382863 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.382754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.383209 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.383177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 17:39:02.383318 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.383302 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.383390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.383321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w46nj\"" Jul 01 17:39:02.383493 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.383475 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 17:39:02.384052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.384031 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l72nc\"" Jul 01 17:39:02.385772 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.385753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:02.385924 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.385902 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:02.388304 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.388286 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.391195 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391178 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.391642 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.391716 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8z8\" (UniqueName: \"kubernetes.io/projected/dffb5813-61bd-49ef-b937-10afd0f20e03-kube-api-access-nh8z8\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.391716 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-daemon-config\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391716 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391682 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-os-release\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.391716 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391710 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391735 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-bin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-multus-certs\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-etc-kubernetes\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-dbus\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-netns\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-cnibin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.391896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-socket-dir-parent\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-cnibin\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.391980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-system-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392092 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdzg\" (UniqueName: \"kubernetes.io/projected/a8be83b4-e3b0-43ae-85af-307b34017cfe-kube-api-access-2cdzg\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392144 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-kubelet-config\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392179 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm5j\" (UniqueName: \"kubernetes.io/projected/14b36aa2-0485-454c-ab34-2c4dd547ae10-kube-api-access-fsm5j\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.392279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392276 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-os-release\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-kubelet\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-hostroot\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-conf-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-system-cni-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392415 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-cni-binary-copy\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-k8s-cni-cncf-io\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.392786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.392464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-multus\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.393573 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.393462 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.395915 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.395891 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.396052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396031 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 17:39:02.396190 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.396327 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396310 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.396420 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396406 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.396542 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.395903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.396658 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396641 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l6kqh\"" Jul 01 17:39:02.396973 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396954 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 17:39:02.397082 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.397049 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zs24j\"" Jul 01 17:39:02.397175 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.396964 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.397290 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.397271 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fxsxv\"" Jul 01 17:39:02.397652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.397630 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.399244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.399222 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 17:39:02.399354 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.399279 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.399354 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.399323 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d4p9j\"" Jul 01 17:39:02.399490 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.399468 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.401136 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.401119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.403694 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.403676 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.404131 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.404110 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 17:39:02.405254 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.405235 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.405343 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.405260 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-frmdj\"" Jul 01 17:39:02.405343 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.405260 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.405849 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.405832 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 17:39:02.405946 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.405878 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 17:39:02.406173 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406155 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 17:39:02.406256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406162 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 17:39:02.406256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406205 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 17:39:02.406947 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406783 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 17:39:02.406947 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406720 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tj5rz\"" Jul 01 17:39:02.406947 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.406911 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dv826\"" Jul 01 17:39:02.408926 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.408907 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 17:39:02.419537 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.419500 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:39:02.456636 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.456613 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjpjf" Jul 01 17:39:02.468106 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.468088 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjpjf" Jul 01 17:39:02.478825 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.478810 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 17:39:02.492680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492661 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-etc-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.492787 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.492787 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07410fd2-0491-4ebd-8579-0608736e1ffd-tmp-dir\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.492787 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492729 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/184cce1d-208c-4837-a3d5-8216330a58a0-iptables-alerter-script\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.492787 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-log-socket\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-sys\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-socket-dir-parent\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-cnibin\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.492948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.492952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-system-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdzg\" (UniqueName: \"kubernetes.io/projected/a8be83b4-e3b0-43ae-85af-307b34017cfe-kube-api-access-2cdzg\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493037 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-socket-dir-parent\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493048 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-system-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493052 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-systemd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493118 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-var-lib-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493181 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-cnibin\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.493241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-kubelet-config\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.493314 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-conf\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493400 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-systemd\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493402 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-kubelet-config\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.493476 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:02.993452897 +0000 UTC m=+2.986722086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vptzs\" (UniqueName: \"kubernetes.io/projected/184cce1d-208c-4837-a3d5-8216330a58a0-kube-api-access-vptzs\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-script-lib\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.493567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-host\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493588 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-conf-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbtt\" (UniqueName: \"kubernetes.io/projected/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-kube-api-access-qqbtt\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493671 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-conf-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlv6n\" (UniqueName: \"kubernetes.io/projected/07410fd2-0491-4ebd-8579-0608736e1ffd-kube-api-access-wlv6n\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.493696 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493716 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-cni-binary-copy\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-multus\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.493766 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:02.9937487 +0000 UTC m=+2.987017897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-tuned\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493804 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-multus\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494067 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgn98\" (UniqueName: \"kubernetes.io/projected/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-kube-api-access-qgn98\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493886 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-daemon-config\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.493953 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysconfig\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494001 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmf7z\" (UniqueName: \"kubernetes.io/projected/cc907bc0-0df4-48d0-940e-ae5facf235bc-kube-api-access-dmf7z\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494045 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184cce1d-208c-4837-a3d5-8216330a58a0-host-slash\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-netd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494115 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-env-overrides\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-os-release\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-etc-kubernetes\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-systemd-units\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494277 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-cni-binary-copy\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.494789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494320 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-dbus\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-etc-kubernetes\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494414 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-os-release\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-netns\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-lib-modules\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-ovn\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06444d6d-8efb-484c-95bd-86946c7b39c5-agent-certs\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-modprobe-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494729 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-var-lib-kubelet\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-bin\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-config\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.495472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494785 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-daemon-config\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-serviceca\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494814 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffb5813-61bd-49ef-b937-10afd0f20e03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494928 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-host\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494955 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d88c438-47ec-4856-ac7a-5afa4057e1d7-dbus\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.494973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-tmp\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-cnibin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495003 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-netns\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-cnibin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-netns\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.496104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-kubernetes\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-kubelet\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495392 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07410fd2-0491-4ebd-8579-0608736e1ffd-hosts-file\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495402 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-multus-cni-dir\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm5j\" (UniqueName: \"kubernetes.io/projected/14b36aa2-0485-454c-ab34-2c4dd547ae10-kube-api-access-fsm5j\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495444 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-os-release\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-kubelet\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-hostroot\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-device-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-552mc\" (UniqueName: \"kubernetes.io/projected/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kube-api-access-552mc\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495542 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-os-release\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495546 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-kubelet\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.496672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495555 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-hostroot\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-system-cni-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-k8s-cni-cncf-io\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495653 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffb5813-61bd-49ef-b937-10afd0f20e03-system-cni-dir\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8z8\" (UniqueName: \"kubernetes.io/projected/dffb5813-61bd-49ef-b937-10afd0f20e03-kube-api-access-nh8z8\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495694 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-slash\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495699 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-k8s-cni-cncf-io\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06444d6d-8efb-484c-95bd-86946c7b39c5-konnectivity-ca\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-bin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-multus-certs\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495781 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-run\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495826 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-var-lib-cni-bin\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.497309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-node-log\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.497888 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.495870 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8be83b4-e3b0-43ae-85af-307b34017cfe-host-run-multus-certs\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.511850 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.511822 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 17:39:02.516112 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.516086 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm5j\" (UniqueName: \"kubernetes.io/projected/14b36aa2-0485-454c-ab34-2c4dd547ae10-kube-api-access-fsm5j\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:02.516193 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.516132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8z8\" (UniqueName: \"kubernetes.io/projected/dffb5813-61bd-49ef-b937-10afd0f20e03-kube-api-access-nh8z8\") pod \"multus-additional-cni-plugins-ptjvf\" (UID: \"dffb5813-61bd-49ef-b937-10afd0f20e03\") " pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.516624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.516607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdzg\" (UniqueName: \"kubernetes.io/projected/a8be83b4-e3b0-43ae-85af-307b34017cfe-kube-api-access-2cdzg\") pod \"multus-xns2r\" (UID: \"a8be83b4-e3b0-43ae-85af-307b34017cfe\") " pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.596675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-run\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596681 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-node-log\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-etc-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596779 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-etc-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596784 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-node-log\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.596851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-socket-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07410fd2-0491-4ebd-8579-0608736e1ffd-tmp-dir\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596852 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-run\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/184cce1d-208c-4837-a3d5-8216330a58a0-iptables-alerter-script\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596896 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-log-socket\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596990 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-log-socket\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.596979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-sys\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-systemd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597042 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-sys\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-var-lib-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597093 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-systemd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-conf\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.597265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-systemd\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vptzs\" (UniqueName: \"kubernetes.io/projected/184cce1d-208c-4837-a3d5-8216330a58a0-kube-api-access-vptzs\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-script-lib\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597188 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07410fd2-0491-4ebd-8579-0608736e1ffd-tmp-dir\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-conf\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597210 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-host\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597251 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-host\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-sys-fs\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597302 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-var-lib-openvswitch\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597301 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-systemd\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbtt\" (UniqueName: \"kubernetes.io/projected/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-kube-api-access-qqbtt\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlv6n\" (UniqueName: \"kubernetes.io/projected/07410fd2-0491-4ebd-8579-0608736e1ffd-kube-api-access-wlv6n\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-tuned\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.598102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgn98\" (UniqueName: \"kubernetes.io/projected/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-kube-api-access-qgn98\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysconfig\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597465 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/184cce1d-208c-4837-a3d5-8216330a58a0-iptables-alerter-script\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmf7z\" (UniqueName: \"kubernetes.io/projected/cc907bc0-0df4-48d0-940e-ae5facf235bc-kube-api-access-dmf7z\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184cce1d-208c-4837-a3d5-8216330a58a0-host-slash\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597576 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184cce1d-208c-4837-a3d5-8216330a58a0-host-slash\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-netd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-env-overrides\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597796 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysconfig\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-systemd-units\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597867 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-script-lib\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597895 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597924 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-systemd-units\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.598862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597950 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-lib-modules\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.597887 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-netd\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-ovn\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06444d6d-8efb-484c-95bd-86946c7b39c5-agent-certs\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598086 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-registration-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598094 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-lib-modules\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-modprobe-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598135 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-run-ovn\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-var-lib-kubelet\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-bin\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598203 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-config\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598218 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-modprobe-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.599655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598250 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-env-overrides\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598267 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-var-lib-kubelet\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-serviceca\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598383 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-cni-bin\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-sysctl-d\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-host\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598551 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-tmp\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598597 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-host\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.600447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598791 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-serviceca\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.601095 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.598787 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovnkube-config\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601240 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-netns\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601317 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-run-netns\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601385 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-kubernetes\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.601444 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601398 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-kubernetes\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.601493 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.601549 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601494 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06444d6d-8efb-484c-95bd-86946c7b39c5-agent-certs\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.601549 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601538 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.601657 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-kubelet\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601657 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601631 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-etc-tuned\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.601657 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601646 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07410fd2-0491-4ebd-8579-0608736e1ffd-hosts-file\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.601810 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601712 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-kubelet\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601810 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07410fd2-0491-4ebd-8579-0608736e1ffd-hosts-file\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.601917 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-device-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.601917 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601868 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-ovn-node-metrics-cert\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.601917 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601876 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-552mc\" (UniqueName: \"kubernetes.io/projected/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kube-api-access-552mc\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.601917 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.602147 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-slash\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.602147 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06444d6d-8efb-484c-95bd-86946c7b39c5-konnectivity-ca\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.602260 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.601911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/954e42cf-4f9a-46ad-bf16-b30dec0f321b-device-dir\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.602325 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.602292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.602382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.602366 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-host-slash\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.602762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.602614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06444d6d-8efb-484c-95bd-86946c7b39c5-konnectivity-ca\") pod \"konnectivity-agent-z5bvt\" (UID: \"06444d6d-8efb-484c-95bd-86946c7b39c5\") " pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.604341 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.602899 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc907bc0-0df4-48d0-940e-ae5facf235bc-tmp\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.610160 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.610137 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmf7z\" (UniqueName: \"kubernetes.io/projected/cc907bc0-0df4-48d0-940e-ae5facf235bc-kube-api-access-dmf7z\") pod \"tuned-g9xl9\" (UID: \"cc907bc0-0df4-48d0-940e-ae5facf235bc\") " pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.610756 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.610733 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:02.610858 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.610760 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:02.610858 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.610775 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:02.610858 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:02.610833 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:03.110817816 +0000 UTC m=+3.104087012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:02.612956 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.612901 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlv6n\" (UniqueName: \"kubernetes.io/projected/07410fd2-0491-4ebd-8579-0608736e1ffd-kube-api-access-wlv6n\") pod \"node-resolver-r4mqk\" (UID: \"07410fd2-0491-4ebd-8579-0608736e1ffd\") " pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.613226 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.613209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgn98\" (UniqueName: \"kubernetes.io/projected/fa3b046d-06d1-44f3-b607-bc66fa0cfe19-kube-api-access-qgn98\") pod \"node-ca-qtw7n\" (UID: \"fa3b046d-06d1-44f3-b607-bc66fa0cfe19\") " pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.614878 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.614854 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbtt\" (UniqueName: \"kubernetes.io/projected/8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7-kube-api-access-qqbtt\") pod \"ovnkube-node-vpnd8\" (UID: \"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.616551 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.616531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vptzs\" (UniqueName: \"kubernetes.io/projected/184cce1d-208c-4837-a3d5-8216330a58a0-kube-api-access-vptzs\") pod \"iptables-alerter-77mrk\" (UID: \"184cce1d-208c-4837-a3d5-8216330a58a0\") " pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.619709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.619681 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-552mc\" (UniqueName: \"kubernetes.io/projected/954e42cf-4f9a-46ad-bf16-b30dec0f321b-kube-api-access-552mc\") pod \"aws-ebs-csi-driver-node-zq9hg\" (UID: \"954e42cf-4f9a-46ad-bf16-b30dec0f321b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.646585 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.646530 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" event={"ID":"33ff0aa068abf04af741b448baaa7956","Type":"ContainerStarted","Data":"a763a407374fbf22c77b8c7979c1835679d4c1b380afdc76d2d592591f8db89f"} Jul 01 17:39:02.647852 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.647826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" event={"ID":"5d49aadf2d9d721fc3745139ad40d239","Type":"ContainerStarted","Data":"445c8e984c65df6393cc07f9edaec7fb37848aa3826d14a642d83896df709d25"} Jul 01 17:39:02.691098 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.691074 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" Jul 01 17:39:02.700969 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.700938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xns2r" Jul 01 17:39:02.701464 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:02.701435 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffb5813_61bd_49ef_b937_10afd0f20e03.slice/crio-e159bccd3d72cc89a6d6fec3e70750b53da0d5ff97246c662757c8c898aadc2f WatchSource:0}: Error finding container e159bccd3d72cc89a6d6fec3e70750b53da0d5ff97246c662757c8c898aadc2f: Status 404 returned error can't find the container with id e159bccd3d72cc89a6d6fec3e70750b53da0d5ff97246c662757c8c898aadc2f Jul 01 17:39:02.710127 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.710110 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" Jul 01 17:39:02.716079 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.716063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-77mrk" Jul 01 17:39:02.723836 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.723812 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" Jul 01 17:39:02.731683 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.731661 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtw7n" Jul 01 17:39:02.738449 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.738428 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:02.746298 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.746275 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r4mqk" Jul 01 17:39:02.752198 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.752178 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:02.820900 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:02.820868 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:03.004332 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.004177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:03.004332 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.004231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:03.004595 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.004396 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:03.004595 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.004437 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:03.004595 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.004464 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:04.004443472 +0000 UTC m=+3.997712648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:03.004595 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.004505 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:04.004482962 +0000 UTC m=+3.997752137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:03.123562 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.123529 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07410fd2_0491_4ebd_8579_0608736e1ffd.slice/crio-32d79c5f34db7668d67676e1f92ac94e6a2017ac7a16ed5f0b845c7d7cf7c964 WatchSource:0}: Error finding container 32d79c5f34db7668d67676e1f92ac94e6a2017ac7a16ed5f0b845c7d7cf7c964: Status 404 returned error can't find the container with id 32d79c5f34db7668d67676e1f92ac94e6a2017ac7a16ed5f0b845c7d7cf7c964 Jul 01 17:39:03.126218 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.125929 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184cce1d_208c_4837_a3d5_8216330a58a0.slice/crio-f4e1a31761a96d58ef799e6ea1c5d7b01774877e0b38294244159fbd37af479d WatchSource:0}: Error finding container f4e1a31761a96d58ef799e6ea1c5d7b01774877e0b38294244159fbd37af479d: Status 404 returned error can't find the container with id f4e1a31761a96d58ef799e6ea1c5d7b01774877e0b38294244159fbd37af479d Jul 01 17:39:03.129356 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.129335 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06444d6d_8efb_484c_95bd_86946c7b39c5.slice/crio-89e6c19f71905189b4c2eebacebec5d760df18b80edd5da4411c01c9fe9ea312 WatchSource:0}: Error finding container 89e6c19f71905189b4c2eebacebec5d760df18b80edd5da4411c01c9fe9ea312: Status 404 returned error can't find the container with id 89e6c19f71905189b4c2eebacebec5d760df18b80edd5da4411c01c9fe9ea312 Jul 01 17:39:03.153335 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.153309 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca1ec6e_c301_4ed2_b33a_ecb61e7654c7.slice/crio-6a5e5baa5e9d2dee9f4ea137d6badb6c6d48e1c6a86653d3f3dc75f54c5113ee WatchSource:0}: Error finding container 6a5e5baa5e9d2dee9f4ea137d6badb6c6d48e1c6a86653d3f3dc75f54c5113ee: Status 404 returned error can't find the container with id 6a5e5baa5e9d2dee9f4ea137d6badb6c6d48e1c6a86653d3f3dc75f54c5113ee Jul 01 17:39:03.154644 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.154619 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954e42cf_4f9a_46ad_bf16_b30dec0f321b.slice/crio-4e97cd56b4dc0ecf5c8ddb1c27813e49f3620939a521d1e3e45fd0024391678a WatchSource:0}: Error finding container 4e97cd56b4dc0ecf5c8ddb1c27813e49f3620939a521d1e3e45fd0024391678a: Status 404 returned error can't find the container with id 4e97cd56b4dc0ecf5c8ddb1c27813e49f3620939a521d1e3e45fd0024391678a Jul 01 17:39:03.156892 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.156846 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc907bc0_0df4_48d0_940e_ae5facf235bc.slice/crio-af408c2f761854368e10ad6eab94a00bdcd3382754a7e8c2f9e9e5ee23225f6d WatchSource:0}: Error finding container af408c2f761854368e10ad6eab94a00bdcd3382754a7e8c2f9e9e5ee23225f6d: Status 404 returned error can't find the container with id af408c2f761854368e10ad6eab94a00bdcd3382754a7e8c2f9e9e5ee23225f6d Jul 01 17:39:03.161776 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.161677 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8be83b4_e3b0_43ae_85af_307b34017cfe.slice/crio-971056f73b3a8b8a3f3045fd941ab84134c3020076c91cef99af85f015779c28 WatchSource:0}: Error finding container 971056f73b3a8b8a3f3045fd941ab84134c3020076c91cef99af85f015779c28: Status 404 returned error can't find the container with id 971056f73b3a8b8a3f3045fd941ab84134c3020076c91cef99af85f015779c28 Jul 01 17:39:03.162766 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:03.162740 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3b046d_06d1_44f3_b607_bc66fa0cfe19.slice/crio-fa686b3515b06654747b12c2728c4200c57c20a4e1498b69c16afdd0de9b1a39 WatchSource:0}: Error finding container fa686b3515b06654747b12c2728c4200c57c20a4e1498b69c16afdd0de9b1a39: Status 404 returned error can't find the container with id fa686b3515b06654747b12c2728c4200c57c20a4e1498b69c16afdd0de9b1a39 Jul 01 17:39:03.205607 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.205581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:03.205731 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.205699 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:03.205731 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.205714 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:03.205731 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.205723 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:03.205895 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:03.205763 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:04.20575029 +0000 UTC m=+4.199019462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:03.471784 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.471718 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:34:03 +0000 UTC" deadline="2028-03-07 18:42:49.154739169 +0000 UTC" Jul 01 17:39:03.471784 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.471782 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14761h3m45.682961186s" Jul 01 17:39:03.477090 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.477060 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:39:03.651262 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.651174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xns2r" event={"ID":"a8be83b4-e3b0-43ae-85af-307b34017cfe","Type":"ContainerStarted","Data":"971056f73b3a8b8a3f3045fd941ab84134c3020076c91cef99af85f015779c28"} Jul 01 17:39:03.652471 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.652432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" event={"ID":"954e42cf-4f9a-46ad-bf16-b30dec0f321b","Type":"ContainerStarted","Data":"4e97cd56b4dc0ecf5c8ddb1c27813e49f3620939a521d1e3e45fd0024391678a"} Jul 01 17:39:03.653599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.653567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z5bvt" event={"ID":"06444d6d-8efb-484c-95bd-86946c7b39c5","Type":"ContainerStarted","Data":"89e6c19f71905189b4c2eebacebec5d760df18b80edd5da4411c01c9fe9ea312"} Jul 01 17:39:03.654779 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.654754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77mrk" event={"ID":"184cce1d-208c-4837-a3d5-8216330a58a0","Type":"ContainerStarted","Data":"f4e1a31761a96d58ef799e6ea1c5d7b01774877e0b38294244159fbd37af479d"} Jul 01 17:39:03.656663 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.656640 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" event={"ID":"33ff0aa068abf04af741b448baaa7956","Type":"ContainerStarted","Data":"a42d175d29eb0ea55a703e6a3fd2f27e0a277361eca4aab708e5d3f18fdaccdb"} Jul 01 17:39:03.657991 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.657968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtw7n" event={"ID":"fa3b046d-06d1-44f3-b607-bc66fa0cfe19","Type":"ContainerStarted","Data":"fa686b3515b06654747b12c2728c4200c57c20a4e1498b69c16afdd0de9b1a39"} Jul 01 17:39:03.659134 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.659108 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" event={"ID":"cc907bc0-0df4-48d0-940e-ae5facf235bc","Type":"ContainerStarted","Data":"af408c2f761854368e10ad6eab94a00bdcd3382754a7e8c2f9e9e5ee23225f6d"} Jul 01 17:39:03.660403 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.660376 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"6a5e5baa5e9d2dee9f4ea137d6badb6c6d48e1c6a86653d3f3dc75f54c5113ee"} Jul 01 17:39:03.661540 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.661517 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4mqk" event={"ID":"07410fd2-0491-4ebd-8579-0608736e1ffd","Type":"ContainerStarted","Data":"32d79c5f34db7668d67676e1f92ac94e6a2017ac7a16ed5f0b845c7d7cf7c964"} Jul 01 17:39:03.662675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:03.662652 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerStarted","Data":"e159bccd3d72cc89a6d6fec3e70750b53da0d5ff97246c662757c8c898aadc2f"} Jul 01 17:39:04.012876 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.012840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:04.013083 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.012896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:04.013083 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.013075 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:04.013203 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.013146 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:06.013125776 +0000 UTC m=+6.006394951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:04.013584 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.013559 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:04.013684 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.013624 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:06.013607085 +0000 UTC m=+6.006876263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:04.215303 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.215211 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:04.215471 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.215405 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:04.215471 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.215431 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:04.215471 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.215445 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:04.215643 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.215521 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:06.215499253 +0000 UTC m=+6.208768427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:04.472936 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.472835 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:34:03 +0000 UTC" deadline="2028-01-23 04:55:08.682282524 +0000 UTC" Jul 01 17:39:04.472936 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.472880 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13691h16m4.209408015s" Jul 01 17:39:04.650896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.650869 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:04.651128 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.650869 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:04.651128 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.650994 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:04.651128 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.651005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:04.651304 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.651122 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:04.651304 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:04.651218 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:04.680068 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.679328 2582 generic.go:356] "Generic (PLEG): container finished" podID="33ff0aa068abf04af741b448baaa7956" containerID="a42d175d29eb0ea55a703e6a3fd2f27e0a277361eca4aab708e5d3f18fdaccdb" exitCode=0 Jul 01 17:39:04.680068 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:04.679377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" event={"ID":"33ff0aa068abf04af741b448baaa7956","Type":"ContainerDied","Data":"a42d175d29eb0ea55a703e6a3fd2f27e0a277361eca4aab708e5d3f18fdaccdb"} Jul 01 17:39:05.691836 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:05.691794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" event={"ID":"5d49aadf2d9d721fc3745139ad40d239","Type":"ContainerStarted","Data":"17f0d01a6f116506a48a13bb430bf1bf2d5b45a58111c11d725e04c9591d76c0"} Jul 01 17:39:05.714273 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:05.713358 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-173.ec2.internal" podStartSLOduration=3.713336323 podStartE2EDuration="3.713336323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:05.712361297 +0000 UTC m=+5.705630496" watchObservedRunningTime="2026-07-01 17:39:05.713336323 +0000 UTC m=+5.706605520" Jul 01 17:39:05.720904 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:05.720873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" event={"ID":"33ff0aa068abf04af741b448baaa7956","Type":"ContainerStarted","Data":"c99af66491f55d2c86064f19ed6f77c6ccb280e942d83634b6d0c2e45d041f33"} Jul 01 17:39:05.744347 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:05.744289 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-173.ec2.internal" podStartSLOduration=3.744268389 podStartE2EDuration="3.744268389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:05.744106228 +0000 UTC m=+5.737375424" watchObservedRunningTime="2026-07-01 17:39:05.744268389 +0000 UTC m=+5.737537586" Jul 01 17:39:06.032526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.032443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:06.032526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.032497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:06.032761 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.032664 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:06.032761 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.032727 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.032706859 +0000 UTC m=+10.025976037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:06.033177 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.033159 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:06.033291 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.033213 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.03319624 +0000 UTC m=+10.026465422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:06.234961 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.234922 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:06.235149 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.235108 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:06.235149 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.235128 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:06.235149 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.235141 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:06.235329 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.235202 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:10.235180836 +0000 UTC m=+10.228450037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:06.643494 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.643461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:06.643669 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.643598 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:06.643669 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.643461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:06.643807 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.643708 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:06.643807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:06.643461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:06.643807 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:06.643786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:08.641677 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:08.641633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:08.641677 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:08.641672 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:08.642250 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:08.641794 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:08.642250 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:08.641859 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:08.642250 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:08.641989 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:08.642250 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:08.642078 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.067438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.067497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.067616 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.067669 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.067698 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:18.067676947 +0000 UTC m=+18.060946136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:10.067742 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.067722 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:18.067705497 +0000 UTC m=+18.060974675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:10.269956 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.269905 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:10.272948 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.270347 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:10.272948 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.270378 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:10.272948 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.270404 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:10.272948 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.270485 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:18.270464144 +0000 UTC m=+18.263733331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.642337 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.642472 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.642874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.642976 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:10.643062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:10.643172 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:10.643133 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:12.641475 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:12.641425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:12.641919 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:12.641582 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:12.641919 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:12.641748 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:12.641919 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:12.641845 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:12.641919 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:12.641858 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:12.642194 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:12.641996 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:14.641545 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:14.641519 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:14.641918 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:14.641580 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:14.641918 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:14.641586 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:14.641918 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:14.641680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:14.641918 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:14.641754 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:14.641918 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:14.641842 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:16.641528 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:16.641490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:16.641970 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:16.641503 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:16.641970 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:16.641616 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:16.641970 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:16.641628 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:16.641970 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:16.641697 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:16.641970 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:16.641764 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:18.133196 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.133149 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:18.133665 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.133220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:18.133665 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.133331 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:18.133665 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.133345 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:18.133665 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.133411 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:34.133389632 +0000 UTC m=+34.126658816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:18.133665 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.133429 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:34.133420025 +0000 UTC m=+34.126689203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:18.334828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.334797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:18.335029 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.334956 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:18.335029 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.334975 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:18.335029 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.334985 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:18.335135 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.335041 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:34.335026908 +0000 UTC m=+34.328296078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:18.641247 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.641214 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:18.641247 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.641228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:18.641435 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.641322 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:18.641435 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.641362 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:18.641435 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:18.641403 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:18.641525 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:18.641465 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:20.642074 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:20.642023 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:20.642628 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:20.642140 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:20.642720 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:20.642688 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:20.644965 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:20.642833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:20.644965 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:20.642860 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:20.644965 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:20.642952 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:22.641227 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:22.641199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:22.641636 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:22.641203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:22.641636 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:22.641280 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:22.641636 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:22.641399 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:22.641636 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:22.641451 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:22.641636 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:22.641507 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:23.759020 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.758645 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xns2r" event={"ID":"a8be83b4-e3b0-43ae-85af-307b34017cfe","Type":"ContainerStarted","Data":"690673a13db73a4b0fa3c94c0ff7f4188112a61d8f7805a0bc4fb8f2c156cede"} Jul 01 17:39:23.760128 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.760106 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" event={"ID":"954e42cf-4f9a-46ad-bf16-b30dec0f321b","Type":"ContainerStarted","Data":"30cd2683cdf9d1a304b95c261731dcb5477636f205525429b315da5a500e3097"} Jul 01 17:39:23.761438 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.761417 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z5bvt" event={"ID":"06444d6d-8efb-484c-95bd-86946c7b39c5","Type":"ContainerStarted","Data":"00f5f49f8227ddc668c84219c103378e580acf9f10582d731459810ac3f77748"} Jul 01 17:39:23.762775 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.762750 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtw7n" event={"ID":"fa3b046d-06d1-44f3-b607-bc66fa0cfe19","Type":"ContainerStarted","Data":"dee57ce360c2704a91f7f4b4e446566f20d7ae7c7489e12c156526c33fc4f57f"} Jul 01 17:39:23.764043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.764022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" event={"ID":"cc907bc0-0df4-48d0-940e-ae5facf235bc","Type":"ContainerStarted","Data":"4803163a2cf911c960351f568f5817f688fa84a2e0be193ff97c56c62d5a78d0"} Jul 01 17:39:23.766481 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.766465 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:39:23.766808 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.766789 2582 generic.go:356] "Generic (PLEG): container finished" podID="8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7" containerID="58ff211d82bb27b6c2045b5e25a32ea487ac82354f50d73fd977c3344a1e073c" exitCode=1 Jul 01 17:39:23.766883 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.766862 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"a983f1b22f64fbf05efb11e1a1d6b00fa018f3db149a07d539b5739ff25f7626"} Jul 01 17:39:23.766964 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.766947 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"fb4d36aad640a5c7953abff755edb6996cd77660400f347f310986c255a8860e"} Jul 01 17:39:23.767024 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.767006 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"de9c0438b28b5f2a84cc5dff56d1d6d1f09f40f35279483fe7987275cd53591e"} Jul 01 17:39:23.767132 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.767054 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"1448bbe6a56b6cf7bd42e76e11eb1abc482488f52b6f15cdd257979be128db09"} Jul 01 17:39:23.767132 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.767091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerDied","Data":"58ff211d82bb27b6c2045b5e25a32ea487ac82354f50d73fd977c3344a1e073c"} Jul 01 17:39:23.767229 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.767134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"b83e105157d9ca0137ca46883cde79707c2d32f5b5064b6555e4d29aa3be3ba0"} Jul 01 17:39:23.768170 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.768153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r4mqk" event={"ID":"07410fd2-0491-4ebd-8579-0608736e1ffd","Type":"ContainerStarted","Data":"df446f098f468b53ee230b1a26156d0574fd207dc95e1897ac03b9be6aa043db"} Jul 01 17:39:23.769513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.769496 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="48257f389ae5f151cb37b2e58ae71be133169cef75b931183b3eaa18a392d4a5" exitCode=0 Jul 01 17:39:23.769577 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.769520 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"48257f389ae5f151cb37b2e58ae71be133169cef75b931183b3eaa18a392d4a5"} Jul 01 17:39:23.779489 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.779450 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xns2r" podStartSLOduration=3.257561291 podStartE2EDuration="22.779439938s" totalImagesPullingTime="19.521878647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:23.778889046 +0000 UTC m=+23.772158238" watchObservedRunningTime="2026-07-01 17:39:23.779439938 +0000 UTC m=+23.772709130" Jul 01 17:39:23.821616 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.821574 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g9xl9" podStartSLOduration=3.332710028 podStartE2EDuration="22.821562932s" totalImagesPullingTime="19.488852904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:23.821250474 +0000 UTC m=+23.814519677" watchObservedRunningTime="2026-07-01 17:39:23.821562932 +0000 UTC m=+23.814832123" Jul 01 17:39:23.840444 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.840411 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qtw7n" podStartSLOduration=3.358375196 podStartE2EDuration="22.840400092s" totalImagesPullingTime="19.482024896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:23.839926183 +0000 UTC m=+23.833195375" watchObservedRunningTime="2026-07-01 17:39:23.840400092 +0000 UTC m=+23.833669283" Jul 01 17:39:23.861527 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.861497 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r4mqk" podStartSLOduration=3.339943633 podStartE2EDuration="22.861489786s" totalImagesPullingTime="19.521546153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:23.861075338 +0000 UTC m=+23.854344524" watchObservedRunningTime="2026-07-01 17:39:23.861489786 +0000 UTC m=+23.854758978" Jul 01 17:39:23.878244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:23.878210 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z5bvt" podStartSLOduration=7.316004489 podStartE2EDuration="22.87819884s" totalImagesPullingTime="15.562194351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:23.877879518 +0000 UTC m=+23.871148708" watchObservedRunningTime="2026-07-01 17:39:23.87819884 +0000 UTC m=+23.871468031" Jul 01 17:39:24.640993 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.640953 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:24.641259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.640953 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:24.641259 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:24.641062 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:24.641259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.640962 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:24.641259 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:24.641165 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:24.641259 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:24.641246 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:24.772730 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.772697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-77mrk" event={"ID":"184cce1d-208c-4837-a3d5-8216330a58a0","Type":"ContainerStarted","Data":"d479dffa1961a3a2fc31b392ac8b5e28e825d43c2ec965d08d3314370066e353"} Jul 01 17:39:24.792604 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.792563 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-77mrk" podStartSLOduration=4.292820889 podStartE2EDuration="23.792551182s" totalImagesPullingTime="19.499730293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:24.792211003 +0000 UTC m=+24.785480195" watchObservedRunningTime="2026-07-01 17:39:24.792551182 +0000 UTC m=+24.785820374" Jul 01 17:39:24.915512 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:24.915492 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 17:39:25.346046 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.346011 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:25.346654 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.346635 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:25.568040 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.567884 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:39:24.915507616Z","UUID":"adea927f-225f-4be6-9036-7428b6585979","Handler":null,"Name":"","Endpoint":""} Jul 01 17:39:25.569731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.569697 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 17:39:25.569865 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.569738 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 17:39:25.778912 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.778860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:39:25.779582 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.779552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"d19b7f4285cb9acc40b4fb1886f6bf9e578a7d5fad4db4e4708ad0c8fd67c54a"} Jul 01 17:39:25.781765 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.781741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" event={"ID":"954e42cf-4f9a-46ad-bf16-b30dec0f321b","Type":"ContainerStarted","Data":"23203877a0d78549b97507c8f2b461e6eb06deb43660297df63817aa2c6d0fad"} Jul 01 17:39:25.782022 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.781978 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:25.782720 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:25.782699 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z5bvt" Jul 01 17:39:26.641701 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:26.641668 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:26.641879 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:26.641819 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:26.641879 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:26.641668 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:26.642028 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:26.641917 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:26.642028 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:26.641668 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:26.642028 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:26.642016 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:28.641347 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:28.641115 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:28.641801 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:28.641123 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:28.641801 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:28.641396 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:28.641801 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:28.641501 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:28.641801 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:28.641127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:28.641801 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:28.641602 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:29.792382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.792122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" event={"ID":"954e42cf-4f9a-46ad-bf16-b30dec0f321b","Type":"ContainerStarted","Data":"683717d17a13016d1444343226166e7b907545effb5b6d9dbd5fff5c32d6d297"} Jul 01 17:39:29.795337 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.795316 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:39:29.795709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.795684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"fe50eb05622f04ef09f17ebf0922d349d9135d64cd7de860457657902e65e19f"} Jul 01 17:39:29.795950 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.795916 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:29.796119 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.796092 2582 scope.go:117] "RemoveContainer" containerID="58ff211d82bb27b6c2045b5e25a32ea487ac82354f50d73fd977c3344a1e073c" Jul 01 17:39:29.798031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.798008 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="c7b8e75869ad5a2ad1f12d1c7fe84b7d6a85f2ea1930e3d17b767cb45cbce3f6" exitCode=0 Jul 01 17:39:29.798114 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.798043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"c7b8e75869ad5a2ad1f12d1c7fe84b7d6a85f2ea1930e3d17b767cb45cbce3f6"} Jul 01 17:39:29.811807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.811787 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:29.812200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:29.812165 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zq9hg" podStartSLOduration=3.19450845 podStartE2EDuration="28.812152969s" totalImagesPullingTime="25.617644519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:29.811401175 +0000 UTC m=+29.804670359" watchObservedRunningTime="2026-07-01 17:39:29.812152969 +0000 UTC m=+29.805422158" Jul 01 17:39:30.644310 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.644282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:30.644463 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.644284 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:30.644463 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:30.644385 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:30.644463 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.644405 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:30.644586 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:30.644478 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:30.644586 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:30.644561 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:30.803664 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.803639 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:39:30.804092 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.804012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" event={"ID":"8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7","Type":"ContainerStarted","Data":"ebd12bb9ae86dfa50e9f3d060a83b403aa084266d57bd7deccdbf24af9f79cd0"} Jul 01 17:39:30.804400 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.804367 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:30.804518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.804440 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:30.820230 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.820208 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:39:30.844775 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:30.844734 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" podStartSLOduration=10.089972275 podStartE2EDuration="29.844723698s" totalImagesPullingTime="19.754751423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:30.844549671 +0000 UTC m=+30.837818911" watchObservedRunningTime="2026-07-01 17:39:30.844723698 +0000 UTC m=+30.837992890" Jul 01 17:39:31.595058 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.595028 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76qms"] Jul 01 17:39:31.595206 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.595160 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:31.595262 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:31.595243 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:31.596645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.596621 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scssm"] Jul 01 17:39:31.596739 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.596706 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:31.596800 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:31.596782 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:31.597794 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.597770 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvc7c"] Jul 01 17:39:31.597883 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.597864 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:31.597977 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:31.597960 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:31.809587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.809556 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="7b39a2581bcee6d0766ce5c9d52791a784fc466d72520393a6ff1b657bffbf9b" exitCode=0 Jul 01 17:39:31.810044 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:31.809633 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"7b39a2581bcee6d0766ce5c9d52791a784fc466d72520393a6ff1b657bffbf9b"} Jul 01 17:39:32.814540 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:32.814372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerStarted","Data":"6579da2e11ada0838761fc7431989525ca6cb1c7d7cfc4678286455bad271ccb"} Jul 01 17:39:33.641134 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:33.641104 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:33.641279 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:33.641199 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cvc7c" podUID="14b36aa2-0485-454c-ab34-2c4dd547ae10" Jul 01 17:39:33.641279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:33.641217 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:33.641279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:33.641114 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:33.641389 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:33.641296 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76qms" podUID="9d88c438-47ec-4856-ac7a-5afa4057e1d7" Jul 01 17:39:33.641389 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:33.641367 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scssm" podUID="9b2b72aa-d421-45ba-99fc-365709a06708" Jul 01 17:39:33.818109 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:33.818076 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="6579da2e11ada0838761fc7431989525ca6cb1c7d7cfc4678286455bad271ccb" exitCode=0 Jul 01 17:39:33.818676 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:33.818117 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"6579da2e11ada0838761fc7431989525ca6cb1c7d7cfc4678286455bad271ccb"} Jul 01 17:39:34.154361 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:34.154332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:34.154503 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:34.154369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:34.154503 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.154462 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:34.154503 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.154465 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:34.154607 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.154519 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret podName:9d88c438-47ec-4856-ac7a-5afa4057e1d7 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.154501913 +0000 UTC m=+66.147771105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret") pod "global-pull-secret-syncer-76qms" (UID: "9d88c438-47ec-4856-ac7a-5afa4057e1d7") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:39:34.154607 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.154533 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.154526472 +0000 UTC m=+66.147795642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:39:34.355945 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:34.355914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:34.356132 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.356100 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:39:34.356132 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.356132 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:39:34.356293 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.356147 2582 projected.go:196] Error preparing data for projected volume kube-api-access-5xf4w for pod openshift-network-diagnostics/network-check-target-scssm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:34.356293 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:34.356211 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w podName:9b2b72aa-d421-45ba-99fc-365709a06708 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.356192253 +0000 UTC m=+66.349461427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xf4w" (UniqueName: "kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w") pod "network-check-target-scssm" (UID: "9b2b72aa-d421-45ba-99fc-365709a06708") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:39:35.324735 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.324707 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-173.ec2.internal" event="NodeReady" Jul 01 17:39:35.325180 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.324838 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 17:39:35.413876 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.413842 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn5c"] Jul 01 17:39:35.415745 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.415717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.426612 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.426594 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 17:39:35.428010 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.427984 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j78qx"] Jul 01 17:39:35.429807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.429787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.430157 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.430139 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 17:39:35.430263 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.430218 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 17:39:35.430311 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.430282 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b9ntr\"" Jul 01 17:39:35.434534 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.434519 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4xn\"" Jul 01 17:39:35.435549 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.435533 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 17:39:35.436015 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.435839 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 17:39:35.445901 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.445880 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn5c"] Jul 01 17:39:35.474141 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.474052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j78qx"] Jul 01 17:39:35.564668 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dc4286-a8fe-4124-8775-8430f68dbde0-tmp-dir\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.564833 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.564833 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tbz\" (UniqueName: \"kubernetes.io/projected/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-kube-api-access-x4tbz\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.564833 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-cert\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.565025 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjlb\" (UniqueName: \"kubernetes.io/projected/14dc4286-a8fe-4124-8775-8430f68dbde0-kube-api-access-xtjlb\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.565025 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.564865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14dc4286-a8fe-4124-8775-8430f68dbde0-config-volume\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.641142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.641103 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:39:35.641314 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.641112 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:39:35.641314 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.641223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:39:35.644224 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.644201 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:39:35.644345 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.644263 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qsp7k\"" Jul 01 17:39:35.645090 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.645074 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:39:35.645090 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.645088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:39:35.645319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.645098 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:39:35.645319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.645183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-47mbs\"" Jul 01 17:39:35.665933 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.665914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dc4286-a8fe-4124-8775-8430f68dbde0-tmp-dir\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.666050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.665963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.666050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.665997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tbz\" (UniqueName: \"kubernetes.io/projected/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-kube-api-access-x4tbz\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.666050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.666024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-cert\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.666200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.666110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjlb\" (UniqueName: \"kubernetes.io/projected/14dc4286-a8fe-4124-8775-8430f68dbde0-kube-api-access-xtjlb\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.666200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.666157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14dc4286-a8fe-4124-8775-8430f68dbde0-config-volume\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.666308 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.666273 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dc4286-a8fe-4124-8775-8430f68dbde0-tmp-dir\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.666367 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:35.666317 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:35.666426 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:35.666388 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:36.16636856 +0000 UTC m=+36.159637738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:35.666675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.666653 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14dc4286-a8fe-4124-8775-8430f68dbde0-config-volume\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.670498 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.670481 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-cert\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.684885 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.684858 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjlb\" (UniqueName: \"kubernetes.io/projected/14dc4286-a8fe-4124-8775-8430f68dbde0-kube-api-access-xtjlb\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:35.687091 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.687071 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tbz\" (UniqueName: \"kubernetes.io/projected/9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3-kube-api-access-x4tbz\") pod \"ingress-canary-vpn5c\" (UID: \"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3\") " pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.727788 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.727728 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vpn5c" Jul 01 17:39:35.898076 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:35.897862 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vpn5c"] Jul 01 17:39:35.899577 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:35.899547 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbf845c_c0b0_410b_aa7a_76f42a2ed7a3.slice/crio-f81e3822796547105a81357ed9ac57b6fa555fa323b334620cc6ba9fbc05272f WatchSource:0}: Error finding container f81e3822796547105a81357ed9ac57b6fa555fa323b334620cc6ba9fbc05272f: Status 404 returned error can't find the container with id f81e3822796547105a81357ed9ac57b6fa555fa323b334620cc6ba9fbc05272f Jul 01 17:39:36.170007 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:36.169961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:36.170185 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:36.170126 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:36.170259 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:36.170208 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:37.170184581 +0000 UTC m=+37.163453750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:36.828277 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:36.828234 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpn5c" event={"ID":"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3","Type":"ContainerStarted","Data":"f81e3822796547105a81357ed9ac57b6fa555fa323b334620cc6ba9fbc05272f"} Jul 01 17:39:37.179022 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:37.178924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:37.179178 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:37.179067 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:37.179178 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:37.179168 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:39.179146428 +0000 UTC m=+39.172415615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:39.195596 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:39.195505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:39.195991 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:39.195652 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:39.195991 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:39.195714 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:43.195698535 +0000 UTC m=+43.188967721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:39.837784 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:39.837740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vpn5c" event={"ID":"9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3","Type":"ContainerStarted","Data":"bb6736d7c1a1b2fd1b5320f0f1b08cebf38141f55bcf9e539eb6260172056746"} Jul 01 17:39:39.840478 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:39.840450 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="21ed107ef11e91980e2a52531af6172f790d59cc9d2c32043e3bd198fcef91df" exitCode=0 Jul 01 17:39:39.840603 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:39.840485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"21ed107ef11e91980e2a52531af6172f790d59cc9d2c32043e3bd198fcef91df"} Jul 01 17:39:39.855449 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:39.855410 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vpn5c" podStartSLOduration=1.966456199 podStartE2EDuration="4.855398235s" totalImagesPullingTime="2.888942036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:39.854668527 +0000 UTC m=+39.847937720" watchObservedRunningTime="2026-07-01 17:39:39.855398235 +0000 UTC m=+39.848667427" Jul 01 17:39:40.845384 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:40.845193 2582 generic.go:356] "Generic (PLEG): container finished" podID="dffb5813-61bd-49ef-b937-10afd0f20e03" containerID="a7aa06491a668db210c8af81ba73988c92e2a6e80e8f4006fcdb1ee4062d6975" exitCode=0 Jul 01 17:39:40.845800 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:40.845273 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerDied","Data":"a7aa06491a668db210c8af81ba73988c92e2a6e80e8f4006fcdb1ee4062d6975"} Jul 01 17:39:41.850600 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:41.850568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" event={"ID":"dffb5813-61bd-49ef-b937-10afd0f20e03","Type":"ContainerStarted","Data":"03d73aee6e30bfcf6380ec9599ea0a7e4929a70a47dc71a200e1dfcb7c54dea1"} Jul 01 17:39:41.881573 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:41.881531 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ptjvf" podStartSLOduration=8.314172018 podStartE2EDuration="40.881513383s" totalImagesPullingTime="32.567341365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:39:41.879806739 +0000 UTC m=+41.873075931" watchObservedRunningTime="2026-07-01 17:39:41.881513383 +0000 UTC m=+41.874782576" Jul 01 17:39:43.224673 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:43.224637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:43.225044 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:43.224744 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:43.225044 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:43.224796 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:51.224783672 +0000 UTC m=+51.218052842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:51.281293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:51.281257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:39:51.281635 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:51.281402 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:39:51.281635 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:51.281471 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:07.281455508 +0000 UTC m=+67.274724678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:39:58.605837 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.605806 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fhzzz"] Jul 01 17:39:58.607609 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.607593 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.611158 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.611140 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 17:39:58.611267 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.611139 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 17:39:58.611409 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.611394 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 17:39:58.612440 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.612421 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zg4cp\"" Jul 01 17:39:58.612732 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.612712 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 17:39:58.617812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.617794 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 17:39:58.628689 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.628665 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fhzzz"] Jul 01 17:39:58.660232 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.660205 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-779fb6d48c-h7x8z"] Jul 01 17:39:58.661683 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.661667 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.666265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.666247 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 17:39:58.666370 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.666280 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 17:39:58.667356 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.667275 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 17:39:58.668759 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.668744 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d7rgv\"" Jul 01 17:39:58.668850 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.668746 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 17:39:58.669672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.669657 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 17:39:58.669755 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.669740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 17:39:58.718739 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.718710 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-779fb6d48c-h7x8z"] Jul 01 17:39:58.731743 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-stats-auth\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.731844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.731844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-snapshots\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.731933 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731843 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.731933 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhdq\" (UniqueName: \"kubernetes.io/projected/e223c107-1c49-422a-b857-6a8dc9e880f3-kube-api-access-pdhdq\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.731933 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-default-certificate\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.731933 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.731946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-tmp\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.732171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.732013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4tt\" (UniqueName: \"kubernetes.io/projected/1940f1cd-db39-442f-9911-ba9c760be227-kube-api-access-rt4tt\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.732171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.732055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.732171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.732104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-service-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.732171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.732134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e223c107-1c49-422a-b857-6a8dc9e880f3-serving-cert\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833380 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833380 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhdq\" (UniqueName: \"kubernetes.io/projected/e223c107-1c49-422a-b857-6a8dc9e880f3-kube-api-access-pdhdq\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-default-certificate\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.833599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-tmp\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833542 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4tt\" (UniqueName: \"kubernetes.io/projected/1940f1cd-db39-442f-9911-ba9c760be227-kube-api-access-rt4tt\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.833599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.833793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-service-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e223c107-1c49-422a-b857-6a8dc9e880f3-serving-cert\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.833793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-stats-auth\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.833793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.833793 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-snapshots\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.834065 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.833803 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-tmp\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.834065 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:58.833827 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:59.333801122 +0000 UTC m=+59.327070311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:39:58.834065 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:58.833891 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:39:58.834065 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:58.833969 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:39:59.333931653 +0000 UTC m=+59.327200832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:39:58.834386 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.834360 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e223c107-1c49-422a-b857-6a8dc9e880f3-snapshots\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.834556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.834531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.834621 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.834536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e223c107-1c49-422a-b857-6a8dc9e880f3-service-ca-bundle\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.837448 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.837420 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e223c107-1c49-422a-b857-6a8dc9e880f3-serving-cert\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.837553 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.837536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-default-certificate\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.837613 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.837583 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-stats-auth\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.847690 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.847667 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhdq\" (UniqueName: \"kubernetes.io/projected/e223c107-1c49-422a-b857-6a8dc9e880f3-kube-api-access-pdhdq\") pod \"insights-operator-5f67b55555-fhzzz\" (UID: \"e223c107-1c49-422a-b857-6a8dc9e880f3\") " pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:58.847766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.847741 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4tt\" (UniqueName: \"kubernetes.io/projected/1940f1cd-db39-442f-9911-ba9c760be227-kube-api-access-rt4tt\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:58.916110 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:58.916042 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" Jul 01 17:39:59.041213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:59.041190 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fhzzz"] Jul 01 17:39:59.043235 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:39:59.043205 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode223c107_1c49_422a_b857_6a8dc9e880f3.slice/crio-00da285e59080ba3a74cfbc9772fed5ae01163c00c5b8bfc3f549b46f7c3acfb WatchSource:0}: Error finding container 00da285e59080ba3a74cfbc9772fed5ae01163c00c5b8bfc3f549b46f7c3acfb: Status 404 returned error can't find the container with id 00da285e59080ba3a74cfbc9772fed5ae01163c00c5b8bfc3f549b46f7c3acfb Jul 01 17:39:59.337520 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:59.337488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:59.337706 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:59.337557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:39:59.337706 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:59.337662 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:39:59.337809 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:59.337667 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:00.337654087 +0000 UTC m=+60.330923257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:39:59.337809 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:39:59.337740 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:00.337720871 +0000 UTC m=+60.330990048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:39:59.894212 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:39:59.894182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" event={"ID":"e223c107-1c49-422a-b857-6a8dc9e880f3","Type":"ContainerStarted","Data":"00da285e59080ba3a74cfbc9772fed5ae01163c00c5b8bfc3f549b46f7c3acfb"} Jul 01 17:40:00.344555 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:00.344526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:00.344712 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:00.344581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:00.344712 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:00.344682 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:02.344666326 +0000 UTC m=+62.337935496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:40:00.344712 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:00.344690 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:40:00.344822 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:00.344720 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:02.344713853 +0000 UTC m=+62.337983023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:40:02.359458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:02.359417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:02.359968 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:02.359534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:02.359968 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:02.359609 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:40:02.359968 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:02.359696 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.359676197 +0000 UTC m=+66.352945373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:40:02.359968 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:02.359716 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.359706298 +0000 UTC m=+66.352975472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:40:02.825233 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:02.825201 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpnd8" Jul 01 17:40:03.904926 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:03.904844 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" event={"ID":"e223c107-1c49-422a-b857-6a8dc9e880f3","Type":"ContainerStarted","Data":"632c26be47a17957999eeaad71949e45d50dcf30e5bb3420498f688353c4e281"} Jul 01 17:40:04.667776 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.667716 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" podStartSLOduration=2.14011352 podStartE2EDuration="6.667701044s" totalImagesPullingTime="4.527587524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:03.933653484 +0000 UTC m=+63.926922676" watchObservedRunningTime="2026-07-01 17:40:04.667701044 +0000 UTC m=+64.660970214" Jul 01 17:40:04.668265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.668248 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7d629"] Jul 01 17:40:04.670180 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.670166 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.674070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.674044 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 17:40:04.675916 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.675897 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 17:40:04.676348 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.676156 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sc8wz\"" Jul 01 17:40:04.687092 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.687071 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7d629"] Jul 01 17:40:04.778799 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.778769 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf2sm\" (UniqueName: \"kubernetes.io/projected/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-api-access-lf2sm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.778973 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.778810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.778973 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.778888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.778973 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.778915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d8bef7-b286-441f-8d62-d78b5e54f5bf-data-volume\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.779111 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.779016 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97d8bef7-b286-441f-8d62-d78b5e54f5bf-crio-socket\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.879589 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf2sm\" (UniqueName: \"kubernetes.io/projected/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-api-access-lf2sm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.879725 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.879725 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:04.879710 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:04.879840 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:04.879761 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:05.379743241 +0000 UTC m=+65.373012412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:04.879840 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.879840 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d8bef7-b286-441f-8d62-d78b5e54f5bf-data-volume\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.880031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97d8bef7-b286-441f-8d62-d78b5e54f5bf-crio-socket\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.880031 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:04.879892 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:04.880031 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:04.879959 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:05.379923499 +0000 UTC m=+65.373192689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : configmap "kube-rbac-proxy" not found Jul 01 17:40:04.880031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.879956 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97d8bef7-b286-441f-8d62-d78b5e54f5bf-crio-socket\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.880186 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.880169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d8bef7-b286-441f-8d62-d78b5e54f5bf-data-volume\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:04.889745 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:04.889718 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf2sm\" (UniqueName: \"kubernetes.io/projected/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-api-access-lf2sm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:05.384351 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:05.384306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:05.384729 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:05.384446 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:05.384729 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:05.384463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:05.384729 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:05.384504 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.384489647 +0000 UTC m=+66.377758820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:05.384729 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:05.384533 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:05.384729 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:05.384590 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:06.384574233 +0000 UTC m=+66.377843405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : configmap "kube-rbac-proxy" not found Jul 01 17:40:06.189566 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.189522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:40:06.189566 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.189570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:40:06.193508 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.193489 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:40:06.193561 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.193532 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:40:06.199978 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.199952 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:40:06.200140 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.200009 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs podName:14b36aa2-0485-454c-ab34-2c4dd547ae10 nodeName:}" failed. No retries permitted until 2026-07-01 17:41:10.199993717 +0000 UTC m=+130.193262887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs") pod "network-metrics-daemon-cvc7c" (UID: "14b36aa2-0485-454c-ab34-2c4dd547ae10") : secret "metrics-daemon-secret" not found Jul 01 17:40:06.202106 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.202088 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d88c438-47ec-4856-ac7a-5afa4057e1d7-original-pull-secret\") pod \"global-pull-secret-syncer-76qms\" (UID: \"9d88c438-47ec-4856-ac7a-5afa4057e1d7\") " pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:40:06.260391 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.260359 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76qms" Jul 01 17:40:06.379194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.379131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76qms"] Jul 01 17:40:06.381651 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:06.381628 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d88c438_47ec_4856_ac7a_5afa4057e1d7.slice/crio-ab0f33c4ea6c7ffc38a0410a5f7ff94f621f020128e581c938a6e73a5ca18ffe WatchSource:0}: Error finding container ab0f33c4ea6c7ffc38a0410a5f7ff94f621f020128e581c938a6e73a5ca18ffe: Status 404 returned error can't find the container with id ab0f33c4ea6c7ffc38a0410a5f7ff94f621f020128e581c938a6e73a5ca18ffe Jul 01 17:40:06.392176 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.392154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.392188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.392244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.392266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.392290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392267 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392334 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392370 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:08.392350249 +0000 UTC m=+68.385619426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : configmap "kube-rbac-proxy" not found Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392386 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:14.392379125 +0000 UTC m=+74.385648295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392399 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:14.392392026 +0000 UTC m=+74.385661195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392408 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:06.392466 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:06.392470 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:08.392456959 +0000 UTC m=+68.385726134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:06.395041 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.395024 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:40:06.405083 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.405063 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:40:06.415971 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.415954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xf4w\" (UniqueName: \"kubernetes.io/projected/9b2b72aa-d421-45ba-99fc-365709a06708-kube-api-access-5xf4w\") pod \"network-check-target-scssm\" (UID: \"9b2b72aa-d421-45ba-99fc-365709a06708\") " pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:40:06.555983 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.555956 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qsp7k\"" Jul 01 17:40:06.563414 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.563394 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:40:06.637335 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.637306 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4mqk_07410fd2-0491-4ebd-8579-0608736e1ffd/dns-node-resolver/0.log" Jul 01 17:40:06.685361 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.685342 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scssm"] Jul 01 17:40:06.687490 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:06.687466 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2b72aa_d421_45ba_99fc_365709a06708.slice/crio-f7881d27c76b626614688e40fd18da2b9e378b8fcb2bce5a85aaf5108abf3aaa WatchSource:0}: Error finding container f7881d27c76b626614688e40fd18da2b9e378b8fcb2bce5a85aaf5108abf3aaa: Status 404 returned error can't find the container with id f7881d27c76b626614688e40fd18da2b9e378b8fcb2bce5a85aaf5108abf3aaa Jul 01 17:40:06.913005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.912914 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scssm" event={"ID":"9b2b72aa-d421-45ba-99fc-365709a06708","Type":"ContainerStarted","Data":"f7881d27c76b626614688e40fd18da2b9e378b8fcb2bce5a85aaf5108abf3aaa"} Jul 01 17:40:06.913884 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:06.913853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76qms" event={"ID":"9d88c438-47ec-4856-ac7a-5afa4057e1d7","Type":"ContainerStarted","Data":"ab0f33c4ea6c7ffc38a0410a5f7ff94f621f020128e581c938a6e73a5ca18ffe"} Jul 01 17:40:07.299398 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:07.299322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:07.299521 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:07.299470 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:40:07.299575 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:07.299537 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls podName:14dc4286-a8fe-4124-8775-8430f68dbde0 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:39.299514536 +0000 UTC m=+99.292783726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls") pod "dns-default-j78qx" (UID: "14dc4286-a8fe-4124-8775-8430f68dbde0") : secret "dns-default-metrics-tls" not found Jul 01 17:40:07.638088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:07.638063 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtw7n_fa3b046d-06d1-44f3-b607-bc66fa0cfe19/node-ca/0.log" Jul 01 17:40:08.407983 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.407932 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:08.408142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.408003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:08.408142 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:08.408101 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:08.408142 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:08.408107 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:08.408253 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:08.408161 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.408146928 +0000 UTC m=+72.401416098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : configmap "kube-rbac-proxy" not found Jul 01 17:40:08.408253 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:08.408176 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.40816914 +0000 UTC m=+72.401438310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:08.437370 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.437326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpn5c_9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3/serve-healthcheck-canary/0.log" Jul 01 17:40:08.848069 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.848030 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-x745c"] Jul 01 17:40:08.849663 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.849647 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:08.854567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.852859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 01 17:40:08.854567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.854136 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sbdqc\"" Jul 01 17:40:08.854567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.854293 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 01 17:40:08.854567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.854389 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 01 17:40:08.856061 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.854909 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:40:08.860334 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.860314 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 01 17:40:08.862202 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.862181 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-x745c"] Jul 01 17:40:08.912078 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.912053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkqdk\" (UniqueName: \"kubernetes.io/projected/b3890b79-5861-42e5-993c-f0149d88f872-kube-api-access-xkqdk\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:08.912196 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.912116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-config\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:08.912244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.912194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3890b79-5861-42e5-993c-f0149d88f872-serving-cert\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:08.912244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:08.912220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-trusted-ca\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.012731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.012698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-config\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.013013 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.012768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3890b79-5861-42e5-993c-f0149d88f872-serving-cert\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.013013 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.012793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-trusted-ca\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.013013 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.012865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkqdk\" (UniqueName: \"kubernetes.io/projected/b3890b79-5861-42e5-993c-f0149d88f872-kube-api-access-xkqdk\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.013479 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.013440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-config\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.013675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.013636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3890b79-5861-42e5-993c-f0149d88f872-trusted-ca\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.015434 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.015394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3890b79-5861-42e5-993c-f0149d88f872-serving-cert\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.022156 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.022132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkqdk\" (UniqueName: \"kubernetes.io/projected/b3890b79-5861-42e5-993c-f0149d88f872-kube-api-access-xkqdk\") pod \"console-operator-7fdbdf9c99-x745c\" (UID: \"b3890b79-5861-42e5-993c-f0149d88f872\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:09.160978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:09.160880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:10.141107 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.141084 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-x745c"] Jul 01 17:40:10.144134 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:10.144106 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3890b79_5861_42e5_993c_f0149d88f872.slice/crio-a2e299ddc130f0d5e8014719b6d0b1585ad9b700ec36f68715a62e37c1c6475c WatchSource:0}: Error finding container a2e299ddc130f0d5e8014719b6d0b1585ad9b700ec36f68715a62e37c1c6475c: Status 404 returned error can't find the container with id a2e299ddc130f0d5e8014719b6d0b1585ad9b700ec36f68715a62e37c1c6475c Jul 01 17:40:10.864816 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.864788 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:40:10.868031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.867995 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.871342 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.871275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 17:40:10.871518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.871502 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mjdl5\"" Jul 01 17:40:10.871729 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.871711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 17:40:10.871888 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.871871 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 17:40:10.876684 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.876661 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 17:40:10.885059 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.885036 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:40:10.926523 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.926483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scssm" event={"ID":"9b2b72aa-d421-45ba-99fc-365709a06708","Type":"ContainerStarted","Data":"61964c59db0e5d4aee8e47b16b9ceb73ddcc0491e78662f6eb7128e4d3aae907"} Jul 01 17:40:10.926697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.926632 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:40:10.927627 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.927627 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" event={"ID":"b3890b79-5861-42e5-993c-f0149d88f872","Type":"ContainerStarted","Data":"a2e299ddc130f0d5e8014719b6d0b1585ad9b700ec36f68715a62e37c1c6475c"} Jul 01 17:40:10.927813 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.927872 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.927872 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.928009 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.928009 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927969 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.928009 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.927990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhwq\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.928161 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.928022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:10.945306 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:10.945253 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-scssm" podStartSLOduration=66.555370922 podStartE2EDuration="1m9.945239815s" totalImagesPullingTime="3.389868893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:10.944829448 +0000 UTC m=+70.938098641" watchObservedRunningTime="2026-07-01 17:40:10.945239815 +0000 UTC m=+70.938509005" Jul 01 17:40:11.029042 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhwq\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029469 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029469 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.029566 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.029546 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:40:11.029566 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.029560 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm: secret "image-registry-tls" not found Jul 01 17:40:11.029706 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.029691 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls podName:a475b2c9-0536-4fe9-974c-46364f59e51b nodeName:}" failed. No retries permitted until 2026-07-01 17:40:11.529671171 +0000 UTC m=+71.522940361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls") pod "image-registry-7d9bbb8d6d-zn5qm" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b") : secret "image-registry-tls" not found Jul 01 17:40:11.029886 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.029859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.030417 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.030390 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.030526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.030424 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.031890 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.031864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.032019 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.031920 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.038480 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.038457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.038587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.038549 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhwq\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.533311 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:11.533273 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:11.533753 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.533433 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:40:11.533753 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.533454 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm: secret "image-registry-tls" not found Jul 01 17:40:11.533753 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:11.533530 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls podName:a475b2c9-0536-4fe9-974c-46364f59e51b nodeName:}" failed. No retries permitted until 2026-07-01 17:40:12.533510222 +0000 UTC m=+72.526779395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls") pod "image-registry-7d9bbb8d6d-zn5qm" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b") : secret "image-registry-tls" not found Jul 01 17:40:12.442422 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:12.442386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:12.442610 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:12.442516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:12.442610 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.442550 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:12.442720 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.442620 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:40:12.442720 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.442637 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:20.442616407 +0000 UTC m=+80.435885589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:12.442720 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.442674 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:20.442658513 +0000 UTC m=+80.435927686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : configmap "kube-rbac-proxy" not found Jul 01 17:40:12.543233 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:12.543196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:12.543591 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.543302 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:40:12.543591 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.543313 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm: secret "image-registry-tls" not found Jul 01 17:40:12.543591 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:12.543362 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls podName:a475b2c9-0536-4fe9-974c-46364f59e51b nodeName:}" failed. No retries permitted until 2026-07-01 17:40:14.543348769 +0000 UTC m=+74.536617939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls") pod "image-registry-7d9bbb8d6d-zn5qm" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b") : secret "image-registry-tls" not found Jul 01 17:40:14.458863 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:14.458827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:14.459362 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:14.458885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:14.459362 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.459042 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:30.459019202 +0000 UTC m=+90.452288378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : configmap references non-existent config key: service-ca.crt Jul 01 17:40:14.459362 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.459062 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 17:40:14.459362 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.459122 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs podName:1940f1cd-db39-442f-9911-ba9c760be227 nodeName:}" failed. No retries permitted until 2026-07-01 17:40:30.459102989 +0000 UTC m=+90.452372173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs") pod "router-default-779fb6d48c-h7x8z" (UID: "1940f1cd-db39-442f-9911-ba9c760be227") : secret "router-metrics-certs-default" not found Jul 01 17:40:14.560087 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:14.560056 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:14.560264 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.560224 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:40:14.560264 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.560246 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm: secret "image-registry-tls" not found Jul 01 17:40:14.560372 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:14.560310 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls podName:a475b2c9-0536-4fe9-974c-46364f59e51b nodeName:}" failed. No retries permitted until 2026-07-01 17:40:18.560291375 +0000 UTC m=+78.553560550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls") pod "image-registry-7d9bbb8d6d-zn5qm" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b") : secret "image-registry-tls" not found Jul 01 17:40:15.943801 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.943764 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76qms" event={"ID":"9d88c438-47ec-4856-ac7a-5afa4057e1d7","Type":"ContainerStarted","Data":"2e416fe5b48fdac1b48a6094eca77da3aacfed79d9c0f267a2ffa60f72877306"} Jul 01 17:40:15.945293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.945268 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/0.log" Jul 01 17:40:15.945417 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.945303 2582 generic.go:356] "Generic (PLEG): container finished" podID="b3890b79-5861-42e5-993c-f0149d88f872" containerID="bfb718db35d29ccadcbb0e99816701add246034a8e80ec75232ccc8f4778eb10" exitCode=255 Jul 01 17:40:15.945417 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.945344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" event={"ID":"b3890b79-5861-42e5-993c-f0149d88f872","Type":"ContainerDied","Data":"bfb718db35d29ccadcbb0e99816701add246034a8e80ec75232ccc8f4778eb10"} Jul 01 17:40:15.945506 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.945494 2582 scope.go:117] "RemoveContainer" containerID="bfb718db35d29ccadcbb0e99816701add246034a8e80ec75232ccc8f4778eb10" Jul 01 17:40:15.971180 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:15.971140 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-76qms" podStartSLOduration=66.432470337 podStartE2EDuration="1m14.97112551s" totalImagesPullingTime="8.538655173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:15.970538636 +0000 UTC m=+75.963807829" watchObservedRunningTime="2026-07-01 17:40:15.97112551 +0000 UTC m=+75.964394701" Jul 01 17:40:16.952170 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.952146 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/1.log" Jul 01 17:40:16.952556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.952544 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/0.log" Jul 01 17:40:16.952595 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.952578 2582 generic.go:356] "Generic (PLEG): container finished" podID="b3890b79-5861-42e5-993c-f0149d88f872" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" exitCode=255 Jul 01 17:40:16.952678 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.952660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" event={"ID":"b3890b79-5861-42e5-993c-f0149d88f872","Type":"ContainerDied","Data":"e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775"} Jul 01 17:40:16.952726 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.952714 2582 scope.go:117] "RemoveContainer" containerID="bfb718db35d29ccadcbb0e99816701add246034a8e80ec75232ccc8f4778eb10" Jul 01 17:40:16.953103 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:16.953077 2582 scope.go:117] "RemoveContainer" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" Jul 01 17:40:16.953258 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:16.953235 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:17.957671 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:17.957647 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/1.log" Jul 01 17:40:17.958155 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:17.958055 2582 scope.go:117] "RemoveContainer" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" Jul 01 17:40:17.958254 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:17.958233 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:18.589518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:18.589471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:18.589700 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:18.589621 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:40:18.589700 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:18.589641 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm: secret "image-registry-tls" not found Jul 01 17:40:18.589771 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:18.589716 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls podName:a475b2c9-0536-4fe9-974c-46364f59e51b nodeName:}" failed. No retries permitted until 2026-07-01 17:40:26.5896974 +0000 UTC m=+86.582966579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls") pod "image-registry-7d9bbb8d6d-zn5qm" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b") : secret "image-registry-tls" not found Jul 01 17:40:19.161103 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:19.161073 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:19.161588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:19.161127 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:19.161588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:19.161523 2582 scope.go:117] "RemoveContainer" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" Jul 01 17:40:19.161739 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:19.161715 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:20.507766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:20.507729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:20.508224 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:20.507786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:20.508224 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:20.507923 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:40:20.508224 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:20.508005 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls podName:97d8bef7-b286-441f-8d62-d78b5e54f5bf nodeName:}" failed. No retries permitted until 2026-07-01 17:40:36.507987147 +0000 UTC m=+96.501256317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7d629" (UID: "97d8bef7-b286-441f-8d62-d78b5e54f5bf") : secret "insights-runtime-extractor-tls" not found Jul 01 17:40:20.508442 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:20.508422 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97d8bef7-b286-441f-8d62-d78b5e54f5bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:26.655383 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.655272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:26.657539 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.657520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"image-registry-7d9bbb8d6d-zn5qm\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:26.783496 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.783454 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:26.913144 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.913074 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:40:26.917102 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:26.917067 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda475b2c9_0536_4fe9_974c_46364f59e51b.slice/crio-039a730dadad96c60d4ca28ad2b80ffe2f05dd9e5744c87ce6f007e7ee179e9e WatchSource:0}: Error finding container 039a730dadad96c60d4ca28ad2b80ffe2f05dd9e5744c87ce6f007e7ee179e9e: Status 404 returned error can't find the container with id 039a730dadad96c60d4ca28ad2b80ffe2f05dd9e5744c87ce6f007e7ee179e9e Jul 01 17:40:26.985021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.984991 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" event={"ID":"a475b2c9-0536-4fe9-974c-46364f59e51b","Type":"ContainerStarted","Data":"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db"} Jul 01 17:40:26.985165 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.985051 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" event={"ID":"a475b2c9-0536-4fe9-974c-46364f59e51b","Type":"ContainerStarted","Data":"039a730dadad96c60d4ca28ad2b80ffe2f05dd9e5744c87ce6f007e7ee179e9e"} Jul 01 17:40:26.985165 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:26.985082 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:27.011531 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:27.011405 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" podStartSLOduration=17.011387485 podStartE2EDuration="17.011387485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:27.009685666 +0000 UTC m=+87.002954871" watchObservedRunningTime="2026-07-01 17:40:27.011387485 +0000 UTC m=+87.004656711" Jul 01 17:40:30.483103 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.483065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:30.483103 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.483108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:30.483697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.483678 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1940f1cd-db39-442f-9911-ba9c760be227-service-ca-bundle\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:30.485299 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.485270 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1940f1cd-db39-442f-9911-ba9c760be227-metrics-certs\") pod \"router-default-779fb6d48c-h7x8z\" (UID: \"1940f1cd-db39-442f-9911-ba9c760be227\") " pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:30.772259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.772182 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d7rgv\"" Jul 01 17:40:30.780275 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.780250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:30.913677 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.913648 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-779fb6d48c-h7x8z"] Jul 01 17:40:30.916492 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:30.916449 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1940f1cd_db39_442f_9911_ba9c760be227.slice/crio-39cc221ddb90e4205b674f3b2ba454105f217acde737a44791e08570ab56d830 WatchSource:0}: Error finding container 39cc221ddb90e4205b674f3b2ba454105f217acde737a44791e08570ab56d830: Status 404 returned error can't find the container with id 39cc221ddb90e4205b674f3b2ba454105f217acde737a44791e08570ab56d830 Jul 01 17:40:30.998889 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.998855 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" event={"ID":"1940f1cd-db39-442f-9911-ba9c760be227","Type":"ContainerStarted","Data":"576f1c888abb703f600798c38e748fc85c3eab1ca400d1235fe1bbf97fb4f434"} Jul 01 17:40:30.999049 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:30.998913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" event={"ID":"1940f1cd-db39-442f-9911-ba9c760be227","Type":"ContainerStarted","Data":"39cc221ddb90e4205b674f3b2ba454105f217acde737a44791e08570ab56d830"} Jul 01 17:40:31.781482 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:31.781451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:31.783871 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:31.783847 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:31.808226 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:31.808182 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" podStartSLOduration=33.808167264 podStartE2EDuration="33.808167264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:31.033493621 +0000 UTC m=+91.026762814" watchObservedRunningTime="2026-07-01 17:40:31.808167264 +0000 UTC m=+91.801436457" Jul 01 17:40:32.002430 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:32.002402 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:32.003610 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:32.003589 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-779fb6d48c-h7x8z" Jul 01 17:40:34.641753 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:34.641723 2582 scope.go:117] "RemoveContainer" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" Jul 01 17:40:35.011963 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.011879 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:40:35.012291 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.012273 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/1.log" Jul 01 17:40:35.012380 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.012311 2582 generic.go:356] "Generic (PLEG): container finished" podID="b3890b79-5861-42e5-993c-f0149d88f872" containerID="7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4" exitCode=255 Jul 01 17:40:35.012380 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.012363 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" event={"ID":"b3890b79-5861-42e5-993c-f0149d88f872","Type":"ContainerDied","Data":"7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4"} Jul 01 17:40:35.012465 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.012419 2582 scope.go:117] "RemoveContainer" containerID="e3abb6105061cccd3605174af80b092196d92ebc0280fbba81aec0415b3d5775" Jul 01 17:40:35.012728 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:35.012712 2582 scope.go:117] "RemoveContainer" containerID="7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4" Jul 01 17:40:35.012893 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:35.012875 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:36.017231 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:36.017204 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:40:36.531630 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:36.531594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:36.533808 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:36.533786 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97d8bef7-b286-441f-8d62-d78b5e54f5bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7d629\" (UID: \"97d8bef7-b286-441f-8d62-d78b5e54f5bf\") " pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:36.778772 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:36.778736 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7d629" Jul 01 17:40:36.902240 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:36.902138 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7d629"] Jul 01 17:40:36.904682 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:36.904655 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d8bef7_b286_441f_8d62_d78b5e54f5bf.slice/crio-4250a44a9161f1dfc92572d848e062db43d84097e0b5d594f29e38d389908b26 WatchSource:0}: Error finding container 4250a44a9161f1dfc92572d848e062db43d84097e0b5d594f29e38d389908b26: Status 404 returned error can't find the container with id 4250a44a9161f1dfc92572d848e062db43d84097e0b5d594f29e38d389908b26 Jul 01 17:40:37.021327 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:37.021295 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7d629" event={"ID":"97d8bef7-b286-441f-8d62-d78b5e54f5bf","Type":"ContainerStarted","Data":"4250a44a9161f1dfc92572d848e062db43d84097e0b5d594f29e38d389908b26"} Jul 01 17:40:39.162022 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.161983 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:39.162501 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.162043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:40:39.162501 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.162369 2582 scope.go:117] "RemoveContainer" containerID="7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4" Jul 01 17:40:39.162636 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:39.162514 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:39.355425 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.355390 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:39.357817 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.357790 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14dc4286-a8fe-4124-8775-8430f68dbde0-metrics-tls\") pod \"dns-default-j78qx\" (UID: \"14dc4286-a8fe-4124-8775-8430f68dbde0\") " pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:39.641965 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.641923 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6c4xn\"" Jul 01 17:40:39.649605 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:39.649579 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:40.361809 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.361779 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:40:40.375301 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.375274 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw"] Jul 01 17:40:40.380080 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.380057 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:40.384476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.384458 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-72r2j\"" Jul 01 17:40:40.389633 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.389611 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 17:40:40.395967 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.395915 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw"] Jul 01 17:40:40.463988 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.463959 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84764d44d6-lqst7"] Jul 01 17:40:40.466908 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.466881 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.497426 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.497395 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84764d44d6-lqst7"] Jul 01 17:40:40.566300 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566273 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfgnn\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-kube-api-access-kfgnn\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566424 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-certificates\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566424 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-ca-trust-extracted\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566487 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566430 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-tls\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566487 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-trusted-ca\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566554 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-image-registry-private-configuration\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566554 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-installation-pull-secrets\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566554 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-bound-sa-token\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.566645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.566572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a66efd11-252c-4c8a-bff1-8de1acd970ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-8kztw\" (UID: \"a66efd11-252c-4c8a-bff1-8de1acd970ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:40.612647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.612612 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j78qx"] Jul 01 17:40:40.614498 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:40.614475 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dc4286_a8fe_4124_8775_8430f68dbde0.slice/crio-547db21c0e58087108946d2adab4d61d42a0b2dcb915611dd48af58b731dcd65 WatchSource:0}: Error finding container 547db21c0e58087108946d2adab4d61d42a0b2dcb915611dd48af58b731dcd65: Status 404 returned error can't find the container with id 547db21c0e58087108946d2adab4d61d42a0b2dcb915611dd48af58b731dcd65 Jul 01 17:40:40.667492 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-trusted-ca\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-image-registry-private-configuration\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-installation-pull-secrets\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-bound-sa-token\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a66efd11-252c-4c8a-bff1-8de1acd970ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-8kztw\" (UID: \"a66efd11-252c-4c8a-bff1-8de1acd970ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:40.667632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgnn\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-kube-api-access-kfgnn\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667903 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-certificates\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667903 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-ca-trust-extracted\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.667903 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.667740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-tls\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.668351 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.668322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-ca-trust-extracted\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.668694 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.668673 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-trusted-ca\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.669015 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.668991 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-certificates\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.670237 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.670216 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a66efd11-252c-4c8a-bff1-8de1acd970ec-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-8kztw\" (UID: \"a66efd11-252c-4c8a-bff1-8de1acd970ec\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:40.670382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.670362 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-image-registry-private-configuration\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.670426 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.670363 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-installation-pull-secrets\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.670611 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.670591 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-registry-tls\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.678212 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.678191 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgnn\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-kube-api-access-kfgnn\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.682970 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.682932 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81edd9a8-973e-4a3e-aaa3-92178d6ce74d-bound-sa-token\") pod \"image-registry-84764d44d6-lqst7\" (UID: \"81edd9a8-973e-4a3e-aaa3-92178d6ce74d\") " pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.691417 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.691400 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:40.781701 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.781634 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:40.842211 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.842179 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw"] Jul 01 17:40:40.843885 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:40.843860 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66efd11_252c_4c8a_bff1_8de1acd970ec.slice/crio-cf2b3cda7216d99e3afe327701a3d48b1c630b3968a07de29f3d11a162841976 WatchSource:0}: Error finding container cf2b3cda7216d99e3afe327701a3d48b1c630b3968a07de29f3d11a162841976: Status 404 returned error can't find the container with id cf2b3cda7216d99e3afe327701a3d48b1c630b3968a07de29f3d11a162841976 Jul 01 17:40:40.910566 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:40.910540 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84764d44d6-lqst7"] Jul 01 17:40:40.913334 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:40.913313 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81edd9a8_973e_4a3e_aaa3_92178d6ce74d.slice/crio-f7cd9b215d735e2ed56a91da761102a0fa29b177a8d03246f2cd12742901dc1e WatchSource:0}: Error finding container f7cd9b215d735e2ed56a91da761102a0fa29b177a8d03246f2cd12742901dc1e: Status 404 returned error can't find the container with id f7cd9b215d735e2ed56a91da761102a0fa29b177a8d03246f2cd12742901dc1e Jul 01 17:40:41.037386 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.037309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" event={"ID":"81edd9a8-973e-4a3e-aaa3-92178d6ce74d","Type":"ContainerStarted","Data":"0a24952d030429cc88a690a763024730fb45eb9abd433f9687070227a7d2ec16"} Jul 01 17:40:41.037386 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.037368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" event={"ID":"81edd9a8-973e-4a3e-aaa3-92178d6ce74d","Type":"ContainerStarted","Data":"f7cd9b215d735e2ed56a91da761102a0fa29b177a8d03246f2cd12742901dc1e"} Jul 01 17:40:41.037587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.037438 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:40:41.039142 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.039116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" event={"ID":"a66efd11-252c-4c8a-bff1-8de1acd970ec","Type":"ContainerStarted","Data":"cf2b3cda7216d99e3afe327701a3d48b1c630b3968a07de29f3d11a162841976"} Jul 01 17:40:41.040499 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.040445 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j78qx" event={"ID":"14dc4286-a8fe-4124-8775-8430f68dbde0","Type":"ContainerStarted","Data":"547db21c0e58087108946d2adab4d61d42a0b2dcb915611dd48af58b731dcd65"} Jul 01 17:40:41.042066 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.042045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7d629" event={"ID":"97d8bef7-b286-441f-8d62-d78b5e54f5bf","Type":"ContainerStarted","Data":"8200647ba5a2e78da8101c753bc182ebe52830bb5ec8da1de5753a940b9f9736"} Jul 01 17:40:41.069341 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.069292 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" podStartSLOduration=1.069279184 podStartE2EDuration="1.069279184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:41.068439323 +0000 UTC m=+101.061708527" watchObservedRunningTime="2026-07-01 17:40:41.069279184 +0000 UTC m=+101.062548375" Jul 01 17:40:41.933591 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:41.933560 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-scssm" Jul 01 17:40:42.047645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:42.047609 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7d629" event={"ID":"97d8bef7-b286-441f-8d62-d78b5e54f5bf","Type":"ContainerStarted","Data":"6a3f8ab283ab5d1e01e9430b2d9c60df29228f99e46e8a87fcee312c5cb9d976"} Jul 01 17:40:43.055687 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.055648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" event={"ID":"a66efd11-252c-4c8a-bff1-8de1acd970ec","Type":"ContainerStarted","Data":"e13af295bd98670f628df1c45abc8a3e2b4e635d4f22b4028714b5d2489fbf01"} Jul 01 17:40:43.056154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.055742 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:43.057631 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.057605 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j78qx" event={"ID":"14dc4286-a8fe-4124-8775-8430f68dbde0","Type":"ContainerStarted","Data":"ea49a1261d33d1bf005113794c7eaf7ed64eef8c706f30f9562f31d11d1199ec"} Jul 01 17:40:43.057762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.057649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j78qx" event={"ID":"14dc4286-a8fe-4124-8775-8430f68dbde0","Type":"ContainerStarted","Data":"273da21c4ef78db5ca00e99804ead686f1193e4f01386e67c512d2c8c90b7896"} Jul 01 17:40:43.057762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.057669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:43.060564 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.060548 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" Jul 01 17:40:43.072017 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.071979 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-8kztw" podStartSLOduration=1.370641806 podStartE2EDuration="3.071966139s" totalImagesPullingTime="1.701324333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:43.071029208 +0000 UTC m=+103.064298401" watchObservedRunningTime="2026-07-01 17:40:43.071966139 +0000 UTC m=+103.065235330" Jul 01 17:40:43.090183 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:43.090124 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j78qx" podStartSLOduration=66.117474542 podStartE2EDuration="1m8.090112396s" totalImagesPullingTime="1.972637854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:43.089146875 +0000 UTC m=+103.082416059" watchObservedRunningTime="2026-07-01 17:40:43.090112396 +0000 UTC m=+103.083381588" Jul 01 17:40:44.019594 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.019556 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-ckmvs"] Jul 01 17:40:44.025382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.025365 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.030115 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.030088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 17:40:44.030632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.030610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:40:44.031389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.031376 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 17:40:44.031762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.031523 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lrlsh\"" Jul 01 17:40:44.031762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.031607 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:40:44.031762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.031610 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:40:44.043023 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.043003 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-ckmvs"] Jul 01 17:40:44.193748 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.193709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwnd5\" (UniqueName: \"kubernetes.io/projected/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-kube-api-access-zwnd5\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.194159 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.193769 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.194159 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.193800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.194159 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.193917 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.294307 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.294226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwnd5\" (UniqueName: \"kubernetes.io/projected/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-kube-api-access-zwnd5\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.294307 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.294262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.294307 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.294281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.294557 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.294435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.294678 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:44.294611 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 17:40:44.294722 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:44.294682 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls podName:2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a nodeName:}" failed. No retries permitted until 2026-07-01 17:40:44.794658579 +0000 UTC m=+104.787927771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-ckmvs" (UID: "2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a") : secret "prometheus-operator-tls" not found Jul 01 17:40:44.295015 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.294999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.296493 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.296477 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.304179 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.304159 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwnd5\" (UniqueName: \"kubernetes.io/projected/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-kube-api-access-zwnd5\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.799499 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:44.799457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:44.799687 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:44.799607 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 17:40:44.799687 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:44.799662 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls podName:2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a nodeName:}" failed. No retries permitted until 2026-07-01 17:40:45.799649635 +0000 UTC m=+105.792918809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-ckmvs" (UID: "2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a") : secret "prometheus-operator-tls" not found Jul 01 17:40:45.809493 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:45.809457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:45.811708 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:45.811688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-ckmvs\" (UID: \"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:45.833739 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:45.833717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" Jul 01 17:40:45.954079 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:45.954055 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-ckmvs"] Jul 01 17:40:45.956182 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:45.956156 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2890d0c5_5cc4_42a7_8774_2bbcef2a4f0a.slice/crio-c7737254482df9b5e4802b779478b89183c511fccc609924dc1f04fe47e0c19e WatchSource:0}: Error finding container c7737254482df9b5e4802b779478b89183c511fccc609924dc1f04fe47e0c19e: Status 404 returned error can't find the container with id c7737254482df9b5e4802b779478b89183c511fccc609924dc1f04fe47e0c19e Jul 01 17:40:46.068456 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:46.068379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" event={"ID":"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a","Type":"ContainerStarted","Data":"c7737254482df9b5e4802b779478b89183c511fccc609924dc1f04fe47e0c19e"} Jul 01 17:40:48.077731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:48.077693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" event={"ID":"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a","Type":"ContainerStarted","Data":"59296b78346e6851662c1c4f4caffd73aee1ea643e176e571570954224e5970a"} Jul 01 17:40:48.078115 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:48.077789 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" event={"ID":"2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a","Type":"ContainerStarted","Data":"29539b927dfbe7d692ad99d84b91a3beaad736c2049818c8675568c358f1131b"} Jul 01 17:40:48.109529 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:48.109479 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-ckmvs" podStartSLOduration=2.764574421 podStartE2EDuration="4.10946594s" totalImagesPullingTime="1.344891519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:48.108139753 +0000 UTC m=+108.101408949" watchObservedRunningTime="2026-07-01 17:40:48.10946594 +0000 UTC m=+108.102735110" Jul 01 17:40:49.641289 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:49.641251 2582 scope.go:117] "RemoveContainer" containerID="7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4" Jul 01 17:40:49.641709 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:49.641448 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-x745c_openshift-console-operator(b3890b79-5861-42e5-993c-f0149d88f872)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podUID="b3890b79-5861-42e5-993c-f0149d88f872" Jul 01 17:40:50.368825 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.368796 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:40:50.459829 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.459798 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv"] Jul 01 17:40:50.462090 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.462061 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.465132 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.465098 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:40:50.465132 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.465127 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 17:40:50.465319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.465102 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fvj4z\"" Jul 01 17:40:50.477227 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.477207 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv"] Jul 01 17:40:50.546698 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.546664 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l94c\" (UniqueName: \"kubernetes.io/projected/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-kube-api-access-8l94c\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.546838 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.546734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.546838 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.546767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.546838 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.546796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.559616 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.559579 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h4bz4"] Jul 01 17:40:50.561736 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.561721 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.567498 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.567476 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:40:50.567953 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.567919 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:40:50.568339 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.568314 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lxnhk\"" Jul 01 17:40:50.572005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.571985 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:40:50.648273 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-sys\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648273 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.648273 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-metrics-client-ca\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648273 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648240 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-wtmp\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-tls\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-textfile\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5lsf\" (UniqueName: \"kubernetes.io/projected/77d78569-464b-471a-ad00-2cd7df273770-kube-api-access-w5lsf\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l94c\" (UniqueName: \"kubernetes.io/projected/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-kube-api-access-8l94c\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.648844 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.648506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-root\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.649499 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.649473 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.650867 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.650842 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.650867 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.650863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.669243 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.669219 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l94c\" (UniqueName: \"kubernetes.io/projected/a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc-kube-api-access-8l94c\") pod \"openshift-state-metrics-57f99c8b49-mq8mv\" (UID: \"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.748900 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.748870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-metrics-client-ca\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.748910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.748982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-wtmp\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-tls\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749088 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-textfile\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749338 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5lsf\" (UniqueName: \"kubernetes.io/projected/77d78569-464b-471a-ad00-2cd7df273770-kube-api-access-w5lsf\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749338 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-root\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749338 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-sys\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749338 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-sys\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749537 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749345 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-root\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749585 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-accelerators-collector-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-textfile\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.749766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.749736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-wtmp\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.750384 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.750343 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77d78569-464b-471a-ad00-2cd7df273770-metrics-client-ca\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.752007 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.751976 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.752211 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.752193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77d78569-464b-471a-ad00-2cd7df273770-node-exporter-tls\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.761105 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.760476 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5lsf\" (UniqueName: \"kubernetes.io/projected/77d78569-464b-471a-ad00-2cd7df273770-kube-api-access-w5lsf\") pod \"node-exporter-h4bz4\" (UID: \"77d78569-464b-471a-ad00-2cd7df273770\") " pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:50.772240 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.772210 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" Jul 01 17:40:50.873286 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:50.873251 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h4bz4" Jul 01 17:40:51.542287 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.542242 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:40:51.555046 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.555017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.560354 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.559899 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:40:51.561221 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.561184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:40:51.561369 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.561273 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:40:51.561510 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.561489 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:40:51.561618 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.561509 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:40:51.561688 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.561640 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dm2jh\"" Jul 01 17:40:51.563048 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.562852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:40:51.563048 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.562917 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:40:51.563048 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.562957 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:40:51.563048 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.562990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:40:51.586045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.586014 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:40:51.657789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.657748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.657795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.657874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.657921 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.657970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4n92\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.658556 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.658288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.740733 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:51.740701 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d78569_464b_471a_ad00_2cd7df273770.slice/crio-2a399aaab803b340e3ff9436cb816dde126ac4122ddb8e6c4d4e7a49df5bcfb3 WatchSource:0}: Error finding container 2a399aaab803b340e3ff9436cb816dde126ac4122ddb8e6c4d4e7a49df5bcfb3: Status 404 returned error can't find the container with id 2a399aaab803b340e3ff9436cb816dde126ac4122ddb8e6c4d4e7a49df5bcfb3 Jul 01 17:40:51.759004 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.758979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759111 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759111 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4n92\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759231 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:51.759139 2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 01 17:40:51.759231 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:40:51.759204 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls podName:384f1212-96e1-4b83-9a43-d05ca527a0fb nodeName:}" failed. No retries permitted until 2026-07-01 17:40:52.259182899 +0000 UTC m=+112.252452071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb") : secret "alertmanager-main-tls" not found Jul 01 17:40:51.759231 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759331 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759331 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759410 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759410 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759868 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759868 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759868 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759868 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.759868 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.759747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.760269 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.760245 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.760747 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.760721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.761031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.761008 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.762591 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.762250 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.762591 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.762549 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.762700 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.762667 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.763017 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.762994 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.763126 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.762993 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.763126 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.763106 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.763818 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.763797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.764338 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.764321 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.770573 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.770554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4n92\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:51.863892 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:51.863864 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv"] Jul 01 17:40:51.865691 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:51.865669 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97ec78b_6e57_43c9_b6c0_efd60b7f9bcc.slice/crio-812360777f3b5f94eada80af43960acde13f91ba2b0aea6d336f872e53764edd WatchSource:0}: Error finding container 812360777f3b5f94eada80af43960acde13f91ba2b0aea6d336f872e53764edd: Status 404 returned error can't find the container with id 812360777f3b5f94eada80af43960acde13f91ba2b0aea6d336f872e53764edd Jul 01 17:40:52.092146 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.092105 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4bz4" event={"ID":"77d78569-464b-471a-ad00-2cd7df273770","Type":"ContainerStarted","Data":"2a399aaab803b340e3ff9436cb816dde126ac4122ddb8e6c4d4e7a49df5bcfb3"} Jul 01 17:40:52.093747 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.093717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" event={"ID":"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc","Type":"ContainerStarted","Data":"4f5fc5ef56d13afe2a48f2d9191a9cbf4a814980147f046621a4bfcea87aba31"} Jul 01 17:40:52.093875 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.093771 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" event={"ID":"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc","Type":"ContainerStarted","Data":"1ac66a508de116dfb2bb7ff57258270545261517f08b1fe05bc6edcf77b5c850"} Jul 01 17:40:52.093875 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.093801 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" event={"ID":"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc","Type":"ContainerStarted","Data":"812360777f3b5f94eada80af43960acde13f91ba2b0aea6d336f872e53764edd"} Jul 01 17:40:52.095547 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.095527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7d629" event={"ID":"97d8bef7-b286-441f-8d62-d78b5e54f5bf","Type":"ContainerStarted","Data":"c6eedc219e0547452f2a56e6949c9eb913b3802a0ca4cf1bc6cac6dc1b2e8312"} Jul 01 17:40:52.116569 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.116527 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7d629" podStartSLOduration=33.377740161 podStartE2EDuration="48.116513355s" totalImagesPullingTime="14.738773194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:40:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:52.115955012 +0000 UTC m=+112.109224196" watchObservedRunningTime="2026-07-01 17:40:52.116513355 +0000 UTC m=+112.109782547" Jul 01 17:40:52.263552 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.263517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:52.265862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.265837 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:52.466680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.466598 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:40:52.616960 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:52.616920 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:40:52.719079 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:52.718990 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384f1212_96e1_4b83_9a43_d05ca527a0fb.slice/crio-f988c7902fb615f4c27b5e79e1abd70d9885283874a680c13d5182e5ccc2fb19 WatchSource:0}: Error finding container f988c7902fb615f4c27b5e79e1abd70d9885283874a680c13d5182e5ccc2fb19: Status 404 returned error can't find the container with id f988c7902fb615f4c27b5e79e1abd70d9885283874a680c13d5182e5ccc2fb19 Jul 01 17:40:53.062726 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:53.062699 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j78qx" Jul 01 17:40:53.101655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:53.101618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"f988c7902fb615f4c27b5e79e1abd70d9885283874a680c13d5182e5ccc2fb19"} Jul 01 17:40:53.103491 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:53.103460 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4bz4" event={"ID":"77d78569-464b-471a-ad00-2cd7df273770","Type":"ContainerStarted","Data":"5af55f6b535ce995454e43b1e29265aa85123a65d9583af7e2c2039f9e4e78a0"} Jul 01 17:40:54.109410 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.109376 2582 generic.go:356] "Generic (PLEG): container finished" podID="77d78569-464b-471a-ad00-2cd7df273770" containerID="5af55f6b535ce995454e43b1e29265aa85123a65d9583af7e2c2039f9e4e78a0" exitCode=0 Jul 01 17:40:54.109830 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.109454 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4bz4" event={"ID":"77d78569-464b-471a-ad00-2cd7df273770","Type":"ContainerDied","Data":"5af55f6b535ce995454e43b1e29265aa85123a65d9583af7e2c2039f9e4e78a0"} Jul 01 17:40:54.111653 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.111624 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" event={"ID":"a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc","Type":"ContainerStarted","Data":"ae8df00739fbe86148fa64ff3f54db220009b71ef37bfbee19891dc848913f6e"} Jul 01 17:40:54.155162 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.155115 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-mq8mv" podStartSLOduration=2.98087692 podStartE2EDuration="4.155099732s" totalImagesPullingTime="1.174222812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:54.154569062 +0000 UTC m=+114.147838257" watchObservedRunningTime="2026-07-01 17:40:54.155099732 +0000 UTC m=+114.148368925" Jul 01 17:40:54.932078 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.932051 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-664b977cd7-hw6zx"] Jul 01 17:40:54.935089 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.935074 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.940557 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.940535 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-50snm70b0bmag\"" Jul 01 17:40:54.941895 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.941877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 17:40:54.941895 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.941886 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 17:40:54.942050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.942025 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:40:54.942099 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.942054 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bstcv\"" Jul 01 17:40:54.942148 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.942123 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 17:40:54.957631 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.957612 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-664b977cd7-hw6zx"] Jul 01 17:40:54.991207 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb485617-09f3-4852-a179-de93d09d3237-audit-log\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991310 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-tls\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991310 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-metrics-server-audit-profiles\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqf8t\" (UniqueName: \"kubernetes.io/projected/eb485617-09f3-4852-a179-de93d09d3237-kube-api-access-cqf8t\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991471 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991430 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-client-certs\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:54.991471 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:54.991452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-client-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-metrics-server-audit-profiles\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqf8t\" (UniqueName: \"kubernetes.io/projected/eb485617-09f3-4852-a179-de93d09d3237-kube-api-access-cqf8t\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-client-certs\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-client-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092881 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb485617-09f3-4852-a179-de93d09d3237-audit-log\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.092881 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.092741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-tls\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.093186 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.093158 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb485617-09f3-4852-a179-de93d09d3237-audit-log\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.093350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.093325 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.093522 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.093505 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb485617-09f3-4852-a179-de93d09d3237-metrics-server-audit-profiles\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.095190 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.095169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-client-ca-bundle\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.095430 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.095414 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-tls\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.095474 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.095459 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb485617-09f3-4852-a179-de93d09d3237-secret-metrics-server-client-certs\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.102974 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.102954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqf8t\" (UniqueName: \"kubernetes.io/projected/eb485617-09f3-4852-a179-de93d09d3237-kube-api-access-cqf8t\") pod \"metrics-server-664b977cd7-hw6zx\" (UID: \"eb485617-09f3-4852-a179-de93d09d3237\") " pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.122254 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.122219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4bz4" event={"ID":"77d78569-464b-471a-ad00-2cd7df273770","Type":"ContainerStarted","Data":"6514c62673c355d2f52d8e8aa4b7485206ed4fbe19ed70955f71bf206fbd4419"} Jul 01 17:40:55.122601 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.122320 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h4bz4" event={"ID":"77d78569-464b-471a-ad00-2cd7df273770","Type":"ContainerStarted","Data":"46ec304e052b75b19514e49e8d33a9d2bcfe5743184796b948d9897aaa49a274"} Jul 01 17:40:55.123695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.123674 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831" exitCode=0 Jul 01 17:40:55.123789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.123710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831"} Jul 01 17:40:55.153587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.153540 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h4bz4" podStartSLOduration=4.061760167 podStartE2EDuration="5.153525191s" totalImagesPullingTime="1.020927573s" totalInitContainerRuntime="70.837451ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:55.153017271 +0000 UTC m=+115.146286464" watchObservedRunningTime="2026-07-01 17:40:55.153525191 +0000 UTC m=+115.146794376" Jul 01 17:40:55.244282 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.244209 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:40:55.370704 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.370685 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-664b977cd7-hw6zx"] Jul 01 17:40:55.372311 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:55.372288 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb485617_09f3_4852_a179_de93d09d3237.slice/crio-c1ae76dd429538d77d72d72a31ca60f94c93cdb640d1434ccd2ef1ccb9982f4e WatchSource:0}: Error finding container c1ae76dd429538d77d72d72a31ca60f94c93cdb640d1434ccd2ef1ccb9982f4e: Status 404 returned error can't find the container with id c1ae76dd429538d77d72d72a31ca60f94c93cdb640d1434ccd2ef1ccb9982f4e Jul 01 17:40:55.751502 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.751470 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf"] Jul 01 17:40:55.754825 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.754803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.759608 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.759581 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 17:40:55.759832 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.759812 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 17:40:55.759912 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.759881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 17:40:55.760004 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.759958 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4s6j4\"" Jul 01 17:40:55.760064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.760017 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 17:40:55.760543 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.760525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 17:40:55.765631 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.765611 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 17:40:55.779394 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.779364 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf"] Jul 01 17:40:55.799453 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799546 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799546 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799502 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-serving-certs-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-metrics-client-ca\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9mc\" (UniqueName: \"kubernetes.io/projected/0856f460-ddbc-40c4-8752-cd832da18bba-kube-api-access-tt9mc\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799740 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799685 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-federate-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799740 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.799825 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.799740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.900773 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.900743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-metrics-client-ca\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.900978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.900780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9mc\" (UniqueName: \"kubernetes.io/projected/0856f460-ddbc-40c4-8752-cd832da18bba-kube-api-access-tt9mc\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901062 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.900993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-federate-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901062 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901169 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901092 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901169 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901161 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-serving-certs-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901583 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-metrics-client-ca\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.901956 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.901911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-serving-certs-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.902048 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.902033 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.904136 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.904115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.904424 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.904400 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-secret-telemeter-client\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.904571 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.904552 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-federate-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.904707 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.904677 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0856f460-ddbc-40c4-8752-cd832da18bba-telemeter-client-tls\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:55.911055 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:55.911033 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9mc\" (UniqueName: \"kubernetes.io/projected/0856f460-ddbc-40c4-8752-cd832da18bba-kube-api-access-tt9mc\") pod \"telemeter-client-5f685dfbdd-ppfxf\" (UID: \"0856f460-ddbc-40c4-8752-cd832da18bba\") " pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:56.066580 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:56.066551 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" Jul 01 17:40:56.132032 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:56.131958 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" event={"ID":"eb485617-09f3-4852-a179-de93d09d3237","Type":"ContainerStarted","Data":"c1ae76dd429538d77d72d72a31ca60f94c93cdb640d1434ccd2ef1ccb9982f4e"} Jul 01 17:40:56.211461 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:56.211438 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf"] Jul 01 17:40:56.213322 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:40:56.213298 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0856f460_ddbc_40c4_8752_cd832da18bba.slice/crio-ebf6143f1682756d84bcd7d86041668c6a1c39a8962db7b6423723c649ccf368 WatchSource:0}: Error finding container ebf6143f1682756d84bcd7d86041668c6a1c39a8962db7b6423723c649ccf368: Status 404 returned error can't find the container with id ebf6143f1682756d84bcd7d86041668c6a1c39a8962db7b6423723c649ccf368 Jul 01 17:40:57.139698 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:57.139661 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" event={"ID":"0856f460-ddbc-40c4-8752-cd832da18bba","Type":"ContainerStarted","Data":"ebf6143f1682756d84bcd7d86041668c6a1c39a8962db7b6423723c649ccf368"} Jul 01 17:40:58.146747 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.146710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1"} Jul 01 17:40:58.147235 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.146825 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241"} Jul 01 17:40:58.147235 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.146868 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5"} Jul 01 17:40:58.147235 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.146895 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207"} Jul 01 17:40:58.147235 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.146931 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5"} Jul 01 17:40:58.148300 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.148268 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" event={"ID":"eb485617-09f3-4852-a179-de93d09d3237","Type":"ContainerStarted","Data":"c27a992251f3c28756c2eef20772837f53c2aafb807bc7666377f9c2c6887db7"} Jul 01 17:40:58.188694 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:58.188646 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" podStartSLOduration=2.048513383 podStartE2EDuration="4.188632225s" totalImagesPullingTime="2.140118842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:58.188297022 +0000 UTC m=+118.181566239" watchObservedRunningTime="2026-07-01 17:40:58.188632225 +0000 UTC m=+118.181901418" Jul 01 17:40:59.154675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:59.154640 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerStarted","Data":"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa"} Jul 01 17:40:59.212762 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:40:59.212659 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.4728736700000002 podStartE2EDuration="8.212640668s" totalImagesPullingTime="4.720406408s" totalInitContainerRuntime="19.36059ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:40:59.205799905 +0000 UTC m=+119.199069111" watchObservedRunningTime="2026-07-01 17:40:59.212640668 +0000 UTC m=+119.205909859" Jul 01 17:41:00.643453 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:00.643421 2582 scope.go:117] "RemoveContainer" containerID="7a2582d6d30730d74aab2f70cdf8e58eff8dda2593da86fea1d366fa823be2f4" Jul 01 17:41:01.165994 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.165972 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:41:01.166106 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.166079 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" event={"ID":"b3890b79-5861-42e5-993c-f0149d88f872","Type":"ContainerStarted","Data":"192cc4038941f4098b0843fe8441b5d8be6cd9dcd1e5eeeeaa12ec3969b77f99"} Jul 01 17:41:01.166410 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.166382 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:41:01.168182 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.168158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" event={"ID":"0856f460-ddbc-40c4-8752-cd832da18bba","Type":"ContainerStarted","Data":"c4a8bd725b108dcd2ac6ba72efc5ca95eee4c7490ede9772b97c583553275943"} Jul 01 17:41:01.168274 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.168201 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" event={"ID":"0856f460-ddbc-40c4-8752-cd832da18bba","Type":"ContainerStarted","Data":"940247ec401bd0dff1515ecf51f1fef9ecaff6c06c7d639834e490e2cf189b83"} Jul 01 17:41:01.187720 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.187680 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" podStartSLOduration=48.415755797 podStartE2EDuration="53.187668541s" totalImagesPullingTime="4.771912744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:01.186055351 +0000 UTC m=+121.179324543" watchObservedRunningTime="2026-07-01 17:41:01.187668541 +0000 UTC m=+121.180937734" Jul 01 17:41:01.673587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:01.673555 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-x745c" Jul 01 17:41:02.052041 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.052011 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84764d44d6-lqst7" Jul 01 17:41:02.069370 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.069341 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-7n8xj"] Jul 01 17:41:02.072871 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.072855 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:02.078966 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.078930 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 17:41:02.079081 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.078996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 17:41:02.079239 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.079223 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gs2n5\"" Jul 01 17:41:02.095525 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.095501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-7n8xj"] Jul 01 17:41:02.162462 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.162435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgm2l\" (UniqueName: \"kubernetes.io/projected/ef9ec5da-cfb3-485d-9cda-db90884789e9-kube-api-access-jgm2l\") pod \"downloads-5499b6fb8f-7n8xj\" (UID: \"ef9ec5da-cfb3-485d-9cda-db90884789e9\") " pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:02.174468 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.174440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" event={"ID":"0856f460-ddbc-40c4-8752-cd832da18bba","Type":"ContainerStarted","Data":"f0910424532b2345a4bde0c793b5c6d50430275e8ec2946a60b42253742e9430"} Jul 01 17:41:02.263952 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.263903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgm2l\" (UniqueName: \"kubernetes.io/projected/ef9ec5da-cfb3-485d-9cda-db90884789e9-kube-api-access-jgm2l\") pod \"downloads-5499b6fb8f-7n8xj\" (UID: \"ef9ec5da-cfb3-485d-9cda-db90884789e9\") " pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:02.282952 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.282896 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f685dfbdd-ppfxf" podStartSLOduration=2.499645794 podStartE2EDuration="7.282883404s" totalImagesPullingTime="4.78323761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:02.280994209 +0000 UTC m=+122.274263411" watchObservedRunningTime="2026-07-01 17:41:02.282883404 +0000 UTC m=+122.276152596" Jul 01 17:41:02.288045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.288010 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgm2l\" (UniqueName: \"kubernetes.io/projected/ef9ec5da-cfb3-485d-9cda-db90884789e9-kube-api-access-jgm2l\") pod \"downloads-5499b6fb8f-7n8xj\" (UID: \"ef9ec5da-cfb3-485d-9cda-db90884789e9\") " pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:02.382697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.382618 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:02.582039 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:02.582006 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-7n8xj"] Jul 01 17:41:02.584452 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:41:02.584422 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9ec5da_cfb3_485d_9cda_db90884789e9.slice/crio-61e220fd7e0e123f9bcc090d927ecea32dc4c2a03624db1b644e7e0756d01bda WatchSource:0}: Error finding container 61e220fd7e0e123f9bcc090d927ecea32dc4c2a03624db1b644e7e0756d01bda: Status 404 returned error can't find the container with id 61e220fd7e0e123f9bcc090d927ecea32dc4c2a03624db1b644e7e0756d01bda Jul 01 17:41:03.179511 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:03.179457 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-7n8xj" event={"ID":"ef9ec5da-cfb3-485d-9cda-db90884789e9","Type":"ContainerStarted","Data":"61e220fd7e0e123f9bcc090d927ecea32dc4c2a03624db1b644e7e0756d01bda"} Jul 01 17:41:05.384194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.384125 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" podUID="a475b2c9-0536-4fe9-974c-46364f59e51b" containerName="registry" containerID="cri-o://4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db" gracePeriod=30 Jul 01 17:41:05.640888 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.640830 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:41:05.699164 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699140 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhwq\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699318 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699197 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699318 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699254 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699318 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699286 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699318 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699316 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699520 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699359 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699520 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699401 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.699520 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.699445 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted\") pod \"a475b2c9-0536-4fe9-974c-46364f59e51b\" (UID: \"a475b2c9-0536-4fe9-974c-46364f59e51b\") " Jul 01 17:41:05.700198 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.700052 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:41:05.700326 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.700277 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:41:05.702333 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.702200 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:41:05.702333 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.702294 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:41:05.702333 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.702294 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:41:05.702537 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.702481 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq" (OuterVolumeSpecName: "kube-api-access-hkhwq") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "kube-api-access-hkhwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:41:05.702759 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.702727 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:41:05.710908 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.710885 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a475b2c9-0536-4fe9-974c-46364f59e51b" (UID: "a475b2c9-0536-4fe9-974c-46364f59e51b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:41:05.800304 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800277 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-tls\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800308 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-installation-pull-secrets\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800324 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-trusted-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800338 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a475b2c9-0536-4fe9-974c-46364f59e51b-image-registry-private-configuration\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800352 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-bound-sa-token\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800361 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a475b2c9-0536-4fe9-974c-46364f59e51b-ca-trust-extracted\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800369 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhwq\" (UniqueName: \"kubernetes.io/projected/a475b2c9-0536-4fe9-974c-46364f59e51b-kube-api-access-hkhwq\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:05.800447 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:05.800387 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a475b2c9-0536-4fe9-974c-46364f59e51b-registry-certificates\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:06.190876 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.190841 2582 generic.go:356] "Generic (PLEG): container finished" podID="a475b2c9-0536-4fe9-974c-46364f59e51b" containerID="4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db" exitCode=0 Jul 01 17:41:06.191038 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.190896 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" Jul 01 17:41:06.191038 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.190895 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" event={"ID":"a475b2c9-0536-4fe9-974c-46364f59e51b","Type":"ContainerDied","Data":"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db"} Jul 01 17:41:06.191102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.191030 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm" event={"ID":"a475b2c9-0536-4fe9-974c-46364f59e51b","Type":"ContainerDied","Data":"039a730dadad96c60d4ca28ad2b80ffe2f05dd9e5744c87ce6f007e7ee179e9e"} Jul 01 17:41:06.191102 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.191062 2582 scope.go:117] "RemoveContainer" containerID="4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db" Jul 01 17:41:06.205390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.205371 2582 scope.go:117] "RemoveContainer" containerID="4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db" Jul 01 17:41:06.205744 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:41:06.205720 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db\": container with ID starting with 4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db not found: ID does not exist" containerID="4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db" Jul 01 17:41:06.205834 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.205748 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db"} err="failed to get container status \"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db\": rpc error: code = NotFound desc = could not find container \"4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db\": container with ID starting with 4c016ed6e211f50b413f3bf8180824e2d62de208fb705ea4ba8f5ecb3d0286db not found: ID does not exist" Jul 01 17:41:06.218468 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.218441 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:41:06.223188 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.223167 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d9bbb8d6d-zn5qm"] Jul 01 17:41:06.648127 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:06.648088 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a475b2c9-0536-4fe9-974c-46364f59e51b" path="/var/lib/kubelet/pods/a475b2c9-0536-4fe9-974c-46364f59e51b/volumes" Jul 01 17:41:10.246765 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:10.246722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:41:10.249322 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:10.249295 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b36aa2-0485-454c-ab34-2c4dd547ae10-metrics-certs\") pod \"network-metrics-daemon-cvc7c\" (UID: \"14b36aa2-0485-454c-ab34-2c4dd547ae10\") " pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:41:10.471160 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:10.471131 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-47mbs\"" Jul 01 17:41:10.478143 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:10.478121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cvc7c" Jul 01 17:41:10.623276 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:10.623256 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cvc7c"] Jul 01 17:41:10.625603 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:41:10.625574 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b36aa2_0485_454c_ab34_2c4dd547ae10.slice/crio-5682479af6fee07369e6d1fbf89b8d49480ab3823663ceec1c2c29661067d336 WatchSource:0}: Error finding container 5682479af6fee07369e6d1fbf89b8d49480ab3823663ceec1c2c29661067d336: Status 404 returned error can't find the container with id 5682479af6fee07369e6d1fbf89b8d49480ab3823663ceec1c2c29661067d336 Jul 01 17:41:11.215910 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:11.215873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvc7c" event={"ID":"14b36aa2-0485-454c-ab34-2c4dd547ae10","Type":"ContainerStarted","Data":"5682479af6fee07369e6d1fbf89b8d49480ab3823663ceec1c2c29661067d336"} Jul 01 17:41:13.225560 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.225517 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvc7c" event={"ID":"14b36aa2-0485-454c-ab34-2c4dd547ae10","Type":"ContainerStarted","Data":"ec3e09836046f6e683a327b6a1a84ba2c018449483784b47c71df5200d2ec0cd"} Jul 01 17:41:13.226112 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.225591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cvc7c" event={"ID":"14b36aa2-0485-454c-ab34-2c4dd547ae10","Type":"ContainerStarted","Data":"05cf7e12cac7486b8a0b9b61eff4a47ba206958253e57313c61d630a4cb893dd"} Jul 01 17:41:13.256722 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.256672 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cvc7c" podStartSLOduration=130.675061671 podStartE2EDuration="2m12.256658927s" totalImagesPullingTime="1.581597256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:13.255168722 +0000 UTC m=+133.248437915" watchObservedRunningTime="2026-07-01 17:41:13.256658927 +0000 UTC m=+133.249928118" Jul 01 17:41:13.292405 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.292377 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:13.292672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.292659 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a475b2c9-0536-4fe9-974c-46364f59e51b" containerName="registry" Jul 01 17:41:13.292672 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.292672 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a475b2c9-0536-4fe9-974c-46364f59e51b" containerName="registry" Jul 01 17:41:13.292756 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.292729 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a475b2c9-0536-4fe9-974c-46364f59e51b" containerName="registry" Jul 01 17:41:13.314994 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.314959 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.315113 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.315019 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:13.319011 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.318990 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 17:41:13.319118 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.319048 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 17:41:13.319473 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.319458 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 17:41:13.319539 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.319511 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6zts\"" Jul 01 17:41:13.320110 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.320095 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 17:41:13.323407 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.323377 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 17:41:13.474786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.474786 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474792 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wxdx\" (UniqueName: \"kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.475021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.475021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474841 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.475021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.475021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.474992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575756 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wxdx\" (UniqueName: \"kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.575954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.575928 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.576783 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.576741 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.576783 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.576759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.576974 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.576759 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.578658 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.578634 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.578763 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.578688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.597094 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.597076 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wxdx\" (UniqueName: \"kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx\") pod \"console-78449f8c54-ppjnh\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.626038 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.626010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:13.813456 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:13.813388 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:13.815830 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:41:13.815804 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e277557_67d9_4c84_89b8_d0109c74e9bb.slice/crio-ac19b26c4d6e90f8e9e4a75e760471b3c7192a0a2abc308b08d51ffed84f0b7b WatchSource:0}: Error finding container ac19b26c4d6e90f8e9e4a75e760471b3c7192a0a2abc308b08d51ffed84f0b7b: Status 404 returned error can't find the container with id ac19b26c4d6e90f8e9e4a75e760471b3c7192a0a2abc308b08d51ffed84f0b7b Jul 01 17:41:14.231552 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:14.231511 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78449f8c54-ppjnh" event={"ID":"4e277557-67d9-4c84-89b8-d0109c74e9bb","Type":"ContainerStarted","Data":"ac19b26c4d6e90f8e9e4a75e760471b3c7192a0a2abc308b08d51ffed84f0b7b"} Jul 01 17:41:15.244770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:15.244727 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:41:15.245247 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:15.244805 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:41:21.461579 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.461533 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:41:21.465120 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.465097 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.475580 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.475560 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 17:41:21.490431 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.490407 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:41:21.646772 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.646954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.646954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.646954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbdmt\" (UniqueName: \"kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.646954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.646954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646914 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.647187 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.646970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbdmt\" (UniqueName: \"kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.747805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.747661 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.748451 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.748382 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.748451 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.748418 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.748638 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.748551 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.748638 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.748573 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.750291 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.750262 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.750572 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.750546 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:21.779486 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:21.779452 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbdmt\" (UniqueName: \"kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt\") pod \"console-7d4db68558-j6fg7\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:22.076445 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:22.076411 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:22.936878 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:22.936851 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:41:22.938453 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:41:22.938427 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9949bbcc_a2cd_439d_9bf1_c1af30a75ef1.slice/crio-0fc865faad7584cf5967379ee81e2815d0d55831c766c4a4e18a05d9e3a49bf1 WatchSource:0}: Error finding container 0fc865faad7584cf5967379ee81e2815d0d55831c766c4a4e18a05d9e3a49bf1: Status 404 returned error can't find the container with id 0fc865faad7584cf5967379ee81e2815d0d55831c766c4a4e18a05d9e3a49bf1 Jul 01 17:41:23.275695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.275579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4db68558-j6fg7" event={"ID":"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1","Type":"ContainerStarted","Data":"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b"} Jul 01 17:41:23.275695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.275652 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4db68558-j6fg7" event={"ID":"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1","Type":"ContainerStarted","Data":"0fc865faad7584cf5967379ee81e2815d0d55831c766c4a4e18a05d9e3a49bf1"} Jul 01 17:41:23.277714 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.277683 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-7n8xj" event={"ID":"ef9ec5da-cfb3-485d-9cda-db90884789e9","Type":"ContainerStarted","Data":"33771754cf7533bbe00d1f84734bcbf77a26fe825ebb513936e8a61ffa3d45a9"} Jul 01 17:41:23.278117 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.278093 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:23.279778 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.279751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78449f8c54-ppjnh" event={"ID":"4e277557-67d9-4c84-89b8-d0109c74e9bb","Type":"ContainerStarted","Data":"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e"} Jul 01 17:41:23.285691 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.285671 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-7n8xj" Jul 01 17:41:23.310388 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.310335 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d4db68558-j6fg7" podStartSLOduration=2.310316834 podStartE2EDuration="2.310316834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:23.309164233 +0000 UTC m=+143.302433426" watchObservedRunningTime="2026-07-01 17:41:23.310316834 +0000 UTC m=+143.303586096" Jul 01 17:41:23.332646 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.332601 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-7n8xj" podStartSLOduration=1.071831379 podStartE2EDuration="21.332571467s" totalImagesPullingTime="20.260740088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:23.33064466 +0000 UTC m=+143.323913852" watchObservedRunningTime="2026-07-01 17:41:23.332571467 +0000 UTC m=+143.325840660" Jul 01 17:41:23.563671 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.563602 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78449f8c54-ppjnh" podStartSLOduration=1.59028433 podStartE2EDuration="10.563581088s" totalImagesPullingTime="8.973296758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:41:23.557172627 +0000 UTC m=+143.550441823" watchObservedRunningTime="2026-07-01 17:41:23.563581088 +0000 UTC m=+143.556850283" Jul 01 17:41:23.626306 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.626256 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:23.626492 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.626325 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:23.633194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:23.633166 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:24.291583 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:24.291545 2582 generic.go:356] "Generic (PLEG): container finished" podID="e223c107-1c49-422a-b857-6a8dc9e880f3" containerID="632c26be47a17957999eeaad71949e45d50dcf30e5bb3420498f688353c4e281" exitCode=0 Jul 01 17:41:24.292140 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:24.291580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" event={"ID":"e223c107-1c49-422a-b857-6a8dc9e880f3","Type":"ContainerDied","Data":"632c26be47a17957999eeaad71949e45d50dcf30e5bb3420498f688353c4e281"} Jul 01 17:41:24.292668 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:24.292306 2582 scope.go:117] "RemoveContainer" containerID="632c26be47a17957999eeaad71949e45d50dcf30e5bb3420498f688353c4e281" Jul 01 17:41:24.296906 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:24.296882 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:25.299165 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:25.299126 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fhzzz" event={"ID":"e223c107-1c49-422a-b857-6a8dc9e880f3","Type":"ContainerStarted","Data":"a1c6c81f9f480538e347aebcf8444b8c003e0302fee0b4f6885980b25f3fc0c7"} Jul 01 17:41:32.076623 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:32.076593 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:32.077310 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:32.076656 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:32.081314 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:32.081293 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:32.335156 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:32.335073 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:41:32.395370 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:32.395335 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:35.250121 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:35.250092 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:41:35.253813 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:35.253792 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-664b977cd7-hw6zx" Jul 01 17:41:57.418643 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.418557 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78449f8c54-ppjnh" podUID="4e277557-67d9-4c84-89b8-d0109c74e9bb" containerName="console" containerID="cri-o://78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e" gracePeriod=15 Jul 01 17:41:57.698923 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.698854 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:57.877070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877083 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wxdx\" (UniqueName: \"kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877102 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877124 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877163 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877256 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877217 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca\") pod \"4e277557-67d9-4c84-89b8-d0109c74e9bb\" (UID: \"4e277557-67d9-4c84-89b8-d0109c74e9bb\") " Jul 01 17:41:57.877622 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877580 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config" (OuterVolumeSpecName: "console-config") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:41:57.877622 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877585 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:41:57.877752 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.877671 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:41:57.879293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.879272 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:41:57.879596 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.879577 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx" (OuterVolumeSpecName: "kube-api-access-9wxdx") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "kube-api-access-9wxdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:41:57.879667 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.879583 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e277557-67d9-4c84-89b8-d0109c74e9bb" (UID: "4e277557-67d9-4c84-89b8-d0109c74e9bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:41:57.978152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978084 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:57.978152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978110 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-service-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:57.978152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978122 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:57.978152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978133 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wxdx\" (UniqueName: \"kubernetes.io/projected/4e277557-67d9-4c84-89b8-d0109c74e9bb-kube-api-access-9wxdx\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:57.978152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978146 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e277557-67d9-4c84-89b8-d0109c74e9bb-console-oauth-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:57.978385 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:57.978158 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e277557-67d9-4c84-89b8-d0109c74e9bb-oauth-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:41:58.439750 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.439710 2582 generic.go:356] "Generic (PLEG): container finished" podID="4e277557-67d9-4c84-89b8-d0109c74e9bb" containerID="78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e" exitCode=0 Jul 01 17:41:58.439750 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.439751 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78449f8c54-ppjnh" Jul 01 17:41:58.440246 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.439767 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78449f8c54-ppjnh" event={"ID":"4e277557-67d9-4c84-89b8-d0109c74e9bb","Type":"ContainerDied","Data":"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e"} Jul 01 17:41:58.440246 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.439817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78449f8c54-ppjnh" event={"ID":"4e277557-67d9-4c84-89b8-d0109c74e9bb","Type":"ContainerDied","Data":"ac19b26c4d6e90f8e9e4a75e760471b3c7192a0a2abc308b08d51ffed84f0b7b"} Jul 01 17:41:58.440246 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.439846 2582 scope.go:117] "RemoveContainer" containerID="78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e" Jul 01 17:41:58.453668 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.453649 2582 scope.go:117] "RemoveContainer" containerID="78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e" Jul 01 17:41:58.453924 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:41:58.453903 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e\": container with ID starting with 78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e not found: ID does not exist" containerID="78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e" Jul 01 17:41:58.453987 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.453955 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e"} err="failed to get container status \"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e\": rpc error: code = NotFound desc = could not find container \"78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e\": container with ID starting with 78e131d0a9db024735644f50d42328700f0f49681cd7ea72b11d1d74b365446e not found: ID does not exist" Jul 01 17:41:58.478483 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.478459 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:58.484799 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.484781 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78449f8c54-ppjnh"] Jul 01 17:41:58.646151 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:41:58.646124 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e277557-67d9-4c84-89b8-d0109c74e9bb" path="/var/lib/kubelet/pods/4e277557-67d9-4c84-89b8-d0109c74e9bb/volumes" Jul 01 17:42:11.351875 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.351843 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:11.487991 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.487929 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="alertmanager" containerID="cri-o://b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" gracePeriod=120 Jul 01 17:42:11.488185 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.487983 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-metric" containerID="cri-o://f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" gracePeriod=120 Jul 01 17:42:11.488185 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.488022 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-web" containerID="cri-o://e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" gracePeriod=120 Jul 01 17:42:11.488185 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.488042 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy" containerID="cri-o://a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" gracePeriod=120 Jul 01 17:42:11.488185 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.488075 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="config-reloader" containerID="cri-o://beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" gracePeriod=120 Jul 01 17:42:11.488185 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:11.488054 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="prom-label-proxy" containerID="cri-o://08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" gracePeriod=120 Jul 01 17:42:12.494804 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494775 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" exitCode=0 Jul 01 17:42:12.494804 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494799 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" exitCode=0 Jul 01 17:42:12.494804 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494805 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" exitCode=0 Jul 01 17:42:12.494804 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494811 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" exitCode=0 Jul 01 17:42:12.495266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494834 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa"} Jul 01 17:42:12.495266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241"} Jul 01 17:42:12.495266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494915 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207"} Jul 01 17:42:12.495266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.494954 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5"} Jul 01 17:42:12.737749 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.737728 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:12.790378 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790316 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790378 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790355 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790380 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790413 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790449 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790472 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790513 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790567 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790564 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790856 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790590 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790856 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790625 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790856 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790648 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4n92\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790856 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790688 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.790856 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790721 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"384f1212-96e1-4b83-9a43-d05ca527a0fb\" (UID: \"384f1212-96e1-4b83-9a43-d05ca527a0fb\") " Jul 01 17:42:12.791141 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.790925 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:12.791259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.791197 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:42:12.791666 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.791590 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:42:12.793805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.793778 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume" (OuterVolumeSpecName: "config-volume") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.795125 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.795098 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.795715 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.795679 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:42:12.796177 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.796141 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92" (OuterVolumeSpecName: "kube-api-access-s4n92") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "kube-api-access-s4n92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:42:12.796265 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.796198 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.796829 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.796793 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.797089 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.797063 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out" (OuterVolumeSpecName: "config-out") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:42:12.797810 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.797782 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.801043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.800999 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.806894 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.806871 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config" (OuterVolumeSpecName: "web-config") pod "384f1212-96e1-4b83-9a43-d05ca527a0fb" (UID: "384f1212-96e1-4b83-9a43-d05ca527a0fb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:42:12.891635 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891613 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-web-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891635 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891636 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891647 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-out\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891657 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4n92\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-kube-api-access-s4n92\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891667 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891677 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891686 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-config-volume\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891693 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-main-tls\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891701 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-cluster-tls-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891710 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/384f1212-96e1-4b83-9a43-d05ca527a0fb-metrics-client-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891719 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/384f1212-96e1-4b83-9a43-d05ca527a0fb-alertmanager-main-db\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891726 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/384f1212-96e1-4b83-9a43-d05ca527a0fb-tls-assets\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:12.891770 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:12.891734 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/384f1212-96e1-4b83-9a43-d05ca527a0fb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:42:13.505726 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505693 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" exitCode=0 Jul 01 17:42:13.505726 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505720 2582 generic.go:356] "Generic (PLEG): container finished" podID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerID="e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" exitCode=0 Jul 01 17:42:13.506181 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505775 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.506181 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1"} Jul 01 17:42:13.506181 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5"} Jul 01 17:42:13.506181 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"384f1212-96e1-4b83-9a43-d05ca527a0fb","Type":"ContainerDied","Data":"f988c7902fb615f4c27b5e79e1abd70d9885283874a680c13d5182e5ccc2fb19"} Jul 01 17:42:13.506181 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.505957 2582 scope.go:117] "RemoveContainer" containerID="08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" Jul 01 17:42:13.514159 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.514140 2582 scope.go:117] "RemoveContainer" containerID="f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" Jul 01 17:42:13.523418 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.523405 2582 scope.go:117] "RemoveContainer" containerID="a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" Jul 01 17:42:13.529978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.529957 2582 scope.go:117] "RemoveContainer" containerID="e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" Jul 01 17:42:13.531869 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.531850 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:13.536656 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.536631 2582 scope.go:117] "RemoveContainer" containerID="beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" Jul 01 17:42:13.543277 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.543257 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:13.543900 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.543883 2582 scope.go:117] "RemoveContainer" containerID="b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" Jul 01 17:42:13.550648 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.550634 2582 scope.go:117] "RemoveContainer" containerID="a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831" Jul 01 17:42:13.556913 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.556898 2582 scope.go:117] "RemoveContainer" containerID="08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" Jul 01 17:42:13.557163 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.557146 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa\": container with ID starting with 08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa not found: ID does not exist" containerID="08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" Jul 01 17:42:13.557216 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557171 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa"} err="failed to get container status \"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa\": rpc error: code = NotFound desc = could not find container \"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa\": container with ID starting with 08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa not found: ID does not exist" Jul 01 17:42:13.557216 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557189 2582 scope.go:117] "RemoveContainer" containerID="f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" Jul 01 17:42:13.557413 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.557396 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1\": container with ID starting with f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1 not found: ID does not exist" containerID="f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" Jul 01 17:42:13.557476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557422 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1"} err="failed to get container status \"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1\": rpc error: code = NotFound desc = could not find container \"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1\": container with ID starting with f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1 not found: ID does not exist" Jul 01 17:42:13.557476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557443 2582 scope.go:117] "RemoveContainer" containerID="a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" Jul 01 17:42:13.557680 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.557661 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241\": container with ID starting with a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241 not found: ID does not exist" containerID="a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" Jul 01 17:42:13.557717 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557694 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241"} err="failed to get container status \"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241\": rpc error: code = NotFound desc = could not find container \"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241\": container with ID starting with a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241 not found: ID does not exist" Jul 01 17:42:13.557717 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557709 2582 scope.go:117] "RemoveContainer" containerID="e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" Jul 01 17:42:13.557955 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.557916 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5\": container with ID starting with e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5 not found: ID does not exist" containerID="e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" Jul 01 17:42:13.558021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557953 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5"} err="failed to get container status \"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5\": rpc error: code = NotFound desc = could not find container \"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5\": container with ID starting with e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5 not found: ID does not exist" Jul 01 17:42:13.558021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.557973 2582 scope.go:117] "RemoveContainer" containerID="beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" Jul 01 17:42:13.558194 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.558178 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207\": container with ID starting with beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207 not found: ID does not exist" containerID="beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" Jul 01 17:42:13.558252 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558199 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207"} err="failed to get container status \"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207\": rpc error: code = NotFound desc = could not find container \"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207\": container with ID starting with beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207 not found: ID does not exist" Jul 01 17:42:13.558252 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558217 2582 scope.go:117] "RemoveContainer" containerID="b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" Jul 01 17:42:13.558437 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.558420 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5\": container with ID starting with b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5 not found: ID does not exist" containerID="b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" Jul 01 17:42:13.558476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558442 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5"} err="failed to get container status \"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5\": rpc error: code = NotFound desc = could not find container \"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5\": container with ID starting with b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5 not found: ID does not exist" Jul 01 17:42:13.558476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558456 2582 scope.go:117] "RemoveContainer" containerID="a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831" Jul 01 17:42:13.558651 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:42:13.558635 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831\": container with ID starting with a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831 not found: ID does not exist" containerID="a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831" Jul 01 17:42:13.558708 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558658 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831"} err="failed to get container status \"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831\": rpc error: code = NotFound desc = could not find container \"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831\": container with ID starting with a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831 not found: ID does not exist" Jul 01 17:42:13.558708 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558677 2582 scope.go:117] "RemoveContainer" containerID="08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa" Jul 01 17:42:13.558870 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558853 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa"} err="failed to get container status \"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa\": rpc error: code = NotFound desc = could not find container \"08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa\": container with ID starting with 08dabc6b90b4f4dc8a03092dfb7e927d3eac8df73589ef610c2aa57e7c4f1daa not found: ID does not exist" Jul 01 17:42:13.558959 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.558871 2582 scope.go:117] "RemoveContainer" containerID="f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1" Jul 01 17:42:13.559080 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559062 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1"} err="failed to get container status \"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1\": rpc error: code = NotFound desc = could not find container \"f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1\": container with ID starting with f6a94aed3be295722208a58eb03a297f0ebb5bbde1463c722f5b03ef59f970a1 not found: ID does not exist" Jul 01 17:42:13.559145 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559081 2582 scope.go:117] "RemoveContainer" containerID="a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241" Jul 01 17:42:13.559268 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559252 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241"} err="failed to get container status \"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241\": rpc error: code = NotFound desc = could not find container \"a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241\": container with ID starting with a749bb67d80f6a967a2e92b760f35b065a45d2f80e86d7e8a95bf76cd057d241 not found: ID does not exist" Jul 01 17:42:13.559327 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559269 2582 scope.go:117] "RemoveContainer" containerID="e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5" Jul 01 17:42:13.559472 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559456 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5"} err="failed to get container status \"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5\": rpc error: code = NotFound desc = could not find container \"e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5\": container with ID starting with e8c80b8cc4e56a433c561a14f537f1ceef7a647d3a7a9ab28cac93f703bfdda5 not found: ID does not exist" Jul 01 17:42:13.559532 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559473 2582 scope.go:117] "RemoveContainer" containerID="beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207" Jul 01 17:42:13.559686 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559670 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207"} err="failed to get container status \"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207\": rpc error: code = NotFound desc = could not find container \"beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207\": container with ID starting with beb45cab7f8d2165052e40ed1dd4a38b2a451b272e187f5da80434817efdb207 not found: ID does not exist" Jul 01 17:42:13.559751 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559687 2582 scope.go:117] "RemoveContainer" containerID="b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5" Jul 01 17:42:13.559890 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559874 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5"} err="failed to get container status \"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5\": rpc error: code = NotFound desc = could not find container \"b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5\": container with ID starting with b3fb940235e31b417951013b561de9304c886fc26a692790d0bdf97b8d0f00f5 not found: ID does not exist" Jul 01 17:42:13.559980 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.559892 2582 scope.go:117] "RemoveContainer" containerID="a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831" Jul 01 17:42:13.560173 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.560156 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831"} err="failed to get container status \"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831\": rpc error: code = NotFound desc = could not find container \"a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831\": container with ID starting with a0f426a1f31eb56fc77d0ec7651a678cce5f357862568666f6ef43d5eb406831 not found: ID does not exist" Jul 01 17:42:13.590146 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590126 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:13.590416 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590404 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="init-config-reloader" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590418 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="init-config-reloader" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590433 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-metric" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590438 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-metric" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590446 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-web" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590451 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-web" Jul 01 17:42:13.590458 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590457 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590462 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590474 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="config-reloader" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590481 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="config-reloader" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590488 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="prom-label-proxy" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590493 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="prom-label-proxy" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590501 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="alertmanager" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590505 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="alertmanager" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590511 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e277557-67d9-4c84-89b8-d0109c74e9bb" containerName="console" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590516 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e277557-67d9-4c84-89b8-d0109c74e9bb" containerName="console" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590567 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="alertmanager" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590575 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e277557-67d9-4c84-89b8-d0109c74e9bb" containerName="console" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590581 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="config-reloader" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590588 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-web" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590594 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy-metric" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590599 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="prom-label-proxy" Jul 01 17:42:13.590624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.590605 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" containerName="kube-rbac-proxy" Jul 01 17:42:13.594031 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.594017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598433 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598508 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598563 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:42:13.598641 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598569 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:42:13.598978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598648 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:42:13.598978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:42:13.598978 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.598879 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dm2jh\"" Jul 01 17:42:13.604818 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.604801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:42:13.610740 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.610723 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:13.696299 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-web-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696477 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696306 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696477 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696477 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwvm\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-kube-api-access-4nwvm\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696477 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696498 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-config-out\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696864 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.696864 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.696725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.797780 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.797780 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.797780 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwvm\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-kube-api-access-4nwvm\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797831 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.797984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-config-out\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798093 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798489 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798489 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-web-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.798740 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.798714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.799074 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.799050 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.800979 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.800955 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.800979 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.800977 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-web-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801061 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801085 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801166 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-config-out\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801217 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc529793-21e7-46db-9922-caf0548e2e33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801449 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801449 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801407 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.801891 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.801864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.803279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.803261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc529793-21e7-46db-9922-caf0548e2e33-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.806884 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.806863 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwvm\" (UniqueName: \"kubernetes.io/projected/fc529793-21e7-46db-9922-caf0548e2e33-kube-api-access-4nwvm\") pod \"alertmanager-main-0\" (UID: \"fc529793-21e7-46db-9922-caf0548e2e33\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:13.904894 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:13.904853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:42:14.070128 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:14.070107 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:42:14.071594 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:42:14.071550 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc529793_21e7_46db_9922_caf0548e2e33.slice/crio-b634a6662e50dec5f62bb17bc9e1ccb001c8610676ecf2fb6899f26704612ce0 WatchSource:0}: Error finding container b634a6662e50dec5f62bb17bc9e1ccb001c8610676ecf2fb6899f26704612ce0: Status 404 returned error can't find the container with id b634a6662e50dec5f62bb17bc9e1ccb001c8610676ecf2fb6899f26704612ce0 Jul 01 17:42:14.510558 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:14.510475 2582 generic.go:356] "Generic (PLEG): container finished" podID="fc529793-21e7-46db-9922-caf0548e2e33" containerID="9ac24b3a8569f335de6d5b34c7724251dc61ebd36730e1ab5b0d6ceb356a4413" exitCode=0 Jul 01 17:42:14.511033 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:14.510567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerDied","Data":"9ac24b3a8569f335de6d5b34c7724251dc61ebd36730e1ab5b0d6ceb356a4413"} Jul 01 17:42:14.511033 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:14.510653 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"b634a6662e50dec5f62bb17bc9e1ccb001c8610676ecf2fb6899f26704612ce0"} Jul 01 17:42:14.646058 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:14.646026 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384f1212-96e1-4b83-9a43-d05ca527a0fb" path="/var/lib/kubelet/pods/384f1212-96e1-4b83-9a43-d05ca527a0fb/volumes" Jul 01 17:42:15.520721 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"413384cb0a02a501d3a60d6ced95bf25307641fb76112628d8bac644577d7dee"} Jul 01 17:42:15.521194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"7410f96ddf411d8330fa25af9bc03ff17a27cfac757f90671b7f9426c3bec76e"} Jul 01 17:42:15.521194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520806 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"498d82a5573ab60a4ce6017a7dbf37bf14e64af5202f876991ccfccb747cb96d"} Jul 01 17:42:15.521194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520847 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"72efa251f307b8c569299648b71f15cc224de804c5b07033ebd308637043ec6e"} Jul 01 17:42:15.521194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"d3bf9b1ec3428e2e338e085bf35752df5f874a18b96b0294f667e8a82dc63813"} Jul 01 17:42:15.521194 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.520926 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc529793-21e7-46db-9922-caf0548e2e33","Type":"ContainerStarted","Data":"391734bba32353532524570011be21d0405b5f746c41ad2a36699b08f88191a9"} Jul 01 17:42:15.668486 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:15.668438 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.650232137 podStartE2EDuration="2.668423967s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.19183ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:42:15.666593439 +0000 UTC m=+195.659862630" watchObservedRunningTime="2026-07-01 17:42:15.668423967 +0000 UTC m=+195.661693158" Jul 01 17:42:36.070114 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.070080 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:42:36.072395 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.072378 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.087105 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.087081 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:42:36.188587 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188610 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pwnp\" (UniqueName: \"kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.188857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.188804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289591 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289713 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289713 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pwnp\" (UniqueName: \"kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289816 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289816 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289927 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289834 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.289927 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.289885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.290342 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.290320 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.290466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.290393 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.290530 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.290513 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.290759 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.290734 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.292141 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.292123 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.292252 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.292234 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.299432 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.299415 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pwnp\" (UniqueName: \"kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp\") pod \"console-5cb866ff7b-6t5n7\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.382290 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.382232 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:36.505892 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.505869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:42:36.507983 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:42:36.507955 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ba33e6_afa9_4c03_a922_0ea5f454a172.slice/crio-ed1d08e87e24673e40cbcd8967fe7d3a664f19f3fa36e1e894f0b31b4e4292d9 WatchSource:0}: Error finding container ed1d08e87e24673e40cbcd8967fe7d3a664f19f3fa36e1e894f0b31b4e4292d9: Status 404 returned error can't find the container with id ed1d08e87e24673e40cbcd8967fe7d3a664f19f3fa36e1e894f0b31b4e4292d9 Jul 01 17:42:36.604543 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.604504 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb866ff7b-6t5n7" event={"ID":"39ba33e6-afa9-4c03-a922-0ea5f454a172","Type":"ContainerStarted","Data":"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b"} Jul 01 17:42:36.604723 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.604595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb866ff7b-6t5n7" event={"ID":"39ba33e6-afa9-4c03-a922-0ea5f454a172","Type":"ContainerStarted","Data":"ed1d08e87e24673e40cbcd8967fe7d3a664f19f3fa36e1e894f0b31b4e4292d9"} Jul 01 17:42:36.630416 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:36.630367 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb866ff7b-6t5n7" podStartSLOduration=0.630352171 podStartE2EDuration="630.352171ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:42:36.628080414 +0000 UTC m=+216.621349608" watchObservedRunningTime="2026-07-01 17:42:36.630352171 +0000 UTC m=+216.623621404" Jul 01 17:42:46.382865 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:46.382810 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:46.383515 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:46.382897 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:46.387573 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:46.387549 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:46.646508 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:46.646427 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:42:46.712919 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:42:46.712886 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:43:11.736503 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:11.736448 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d4db68558-j6fg7" podUID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" containerName="console" containerID="cri-o://8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b" gracePeriod=15 Jul 01 17:43:11.979094 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:11.979072 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:43:12.088475 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088444 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088490 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbdmt\" (UniqueName: \"kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088524 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088567 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088594 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088621 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.088652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088646 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert\") pod \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\" (UID: \"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1\") " Jul 01 17:43:12.089005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088965 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config" (OuterVolumeSpecName: "console-config") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:43:12.089005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.088985 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:43:12.089193 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.089142 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:43:12.089262 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.089223 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:43:12.090704 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.090682 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt" (OuterVolumeSpecName: "kube-api-access-nbdmt") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "kube-api-access-nbdmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:43:12.090846 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.090823 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:43:12.090891 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.090841 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" (UID: "9949bbcc-a2cd-439d-9bf1-c1af30a75ef1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:43:12.189536 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189507 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-oauth-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189536 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189529 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-oauth-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189536 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189538 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189547 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-trusted-ca-bundle\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189555 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbdmt\" (UniqueName: \"kubernetes.io/projected/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-kube-api-access-nbdmt\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189564 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-console-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.189711 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.189572 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1-service-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:43:12.747459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.747421 2582 generic.go:356] "Generic (PLEG): container finished" podID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" containerID="8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b" exitCode=0 Jul 01 17:43:12.747835 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.747467 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4db68558-j6fg7" Jul 01 17:43:12.747835 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.747519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4db68558-j6fg7" event={"ID":"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1","Type":"ContainerDied","Data":"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b"} Jul 01 17:43:12.747835 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.747568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4db68558-j6fg7" event={"ID":"9949bbcc-a2cd-439d-9bf1-c1af30a75ef1","Type":"ContainerDied","Data":"0fc865faad7584cf5967379ee81e2815d0d55831c766c4a4e18a05d9e3a49bf1"} Jul 01 17:43:12.747835 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.747588 2582 scope.go:117] "RemoveContainer" containerID="8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b" Jul 01 17:43:12.755417 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.755384 2582 scope.go:117] "RemoveContainer" containerID="8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b" Jul 01 17:43:12.755663 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:43:12.755644 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b\": container with ID starting with 8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b not found: ID does not exist" containerID="8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b" Jul 01 17:43:12.755737 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.755675 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b"} err="failed to get container status \"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b\": rpc error: code = NotFound desc = could not find container \"8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b\": container with ID starting with 8805a550d9508a0ad4781b6b59580107457babc2266a97cd624d600659843c2b not found: ID does not exist" Jul 01 17:43:12.773003 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.772984 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:43:12.776767 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:12.776748 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d4db68558-j6fg7"] Jul 01 17:43:14.645557 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:43:14.645524 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" path="/var/lib/kubelet/pods/9949bbcc-a2cd-439d-9bf1-c1af30a75ef1/volumes" Jul 01 17:44:00.470662 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:00.470636 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:44:00.470662 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:00.470661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:44:00.476146 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:00.476126 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:44:00.476276 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:00.476132 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:44:29.690960 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.690910 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5"] Jul 01 17:44:29.693293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.691362 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" containerName="console" Jul 01 17:44:29.693293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.691378 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" containerName="console" Jul 01 17:44:29.693293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.691446 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9949bbcc-a2cd-439d-9bf1-c1af30a75ef1" containerName="console" Jul 01 17:44:29.694126 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.694108 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.697595 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.697575 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 01 17:44:29.697681 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.697642 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 01 17:44:29.698852 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.698837 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wzfz7\"" Jul 01 17:44:29.714516 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.714496 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5"] Jul 01 17:44:29.791106 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.791084 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.791204 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.791129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9hh\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-kube-api-access-mg9hh\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.892001 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.891978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.892150 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.892033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9hh\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-kube-api-access-mg9hh\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.909354 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.909327 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:29.909487 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:29.909461 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9hh\" (UniqueName: \"kubernetes.io/projected/b1c75dd9-d84a-4695-920c-6e3c1fba3eaf-kube-api-access-mg9hh\") pod \"cert-manager-webhook-7dc76cbb94-ww8k5\" (UID: \"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:30.013771 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:30.013692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:30.149508 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:30.149480 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5"] Jul 01 17:44:30.151207 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:44:30.151169 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1c75dd9_d84a_4695_920c_6e3c1fba3eaf.slice/crio-d49ff2a63a2b1ec5c5d678ed047b6d6789c56845b19f3a4bced456e9ab599e2b WatchSource:0}: Error finding container d49ff2a63a2b1ec5c5d678ed047b6d6789c56845b19f3a4bced456e9ab599e2b: Status 404 returned error can't find the container with id d49ff2a63a2b1ec5c5d678ed047b6d6789c56845b19f3a4bced456e9ab599e2b Jul 01 17:44:30.153487 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:30.153474 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:44:31.045286 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:31.045249 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" event={"ID":"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf","Type":"ContainerStarted","Data":"d49ff2a63a2b1ec5c5d678ed047b6d6789c56845b19f3a4bced456e9ab599e2b"} Jul 01 17:44:34.061389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:34.061356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" event={"ID":"b1c75dd9-d84a-4695-920c-6e3c1fba3eaf","Type":"ContainerStarted","Data":"d13f2dbfcd38ad6c4e45d6f0d3fbc51a289760cd2822773c41919c286f044f5e"} Jul 01 17:44:34.061801 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:34.061462 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:40.067198 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.067168 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" Jul 01 17:44:40.103264 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.103213 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-ww8k5" podStartSLOduration=7.859403979 podStartE2EDuration="11.103199286s" totalImagesPullingTime="3.243795307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:44:34.09647346 +0000 UTC m=+334.089742653" watchObservedRunningTime="2026-07-01 17:44:40.103199286 +0000 UTC m=+340.096468478" Jul 01 17:44:40.886348 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.886313 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs"] Jul 01 17:44:40.889554 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.889533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:40.893680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.893660 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 17:44:40.894394 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.894376 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:44:40.895330 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.895310 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bm6cp\"" Jul 01 17:44:40.917168 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.917143 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs"] Jul 01 17:44:40.985811 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.985784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:40.985909 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:40.985837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptn6f\" (UniqueName: \"kubernetes.io/projected/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-kube-api-access-ptn6f\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.086558 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.086528 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptn6f\" (UniqueName: \"kubernetes.io/projected/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-kube-api-access-ptn6f\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.086885 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.086618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.086996 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.086976 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.098604 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.098580 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptn6f\" (UniqueName: \"kubernetes.io/projected/87ab3f33-6fd8-4b55-b9f0-03373997c4d8-kube-api-access-ptn6f\") pod \"openshift-lws-operator-fd8ccff4c-rbfxs\" (UID: \"87ab3f33-6fd8-4b55-b9f0-03373997c4d8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.198136 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.198070 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" Jul 01 17:44:41.348017 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:41.347979 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs"] Jul 01 17:44:41.350678 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:44:41.350654 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ab3f33_6fd8_4b55_b9f0_03373997c4d8.slice/crio-3f310f5aa0ec480624874e2dd0efd37660c79ddfe70cd8464c9d4fd1cd9c2cdd WatchSource:0}: Error finding container 3f310f5aa0ec480624874e2dd0efd37660c79ddfe70cd8464c9d4fd1cd9c2cdd: Status 404 returned error can't find the container with id 3f310f5aa0ec480624874e2dd0efd37660c79ddfe70cd8464c9d4fd1cd9c2cdd Jul 01 17:44:42.094738 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:42.094699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" event={"ID":"87ab3f33-6fd8-4b55-b9f0-03373997c4d8","Type":"ContainerStarted","Data":"3f310f5aa0ec480624874e2dd0efd37660c79ddfe70cd8464c9d4fd1cd9c2cdd"} Jul 01 17:44:45.109599 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:45.109565 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" event={"ID":"87ab3f33-6fd8-4b55-b9f0-03373997c4d8","Type":"ContainerStarted","Data":"acb94e91b4f88db19cf8cc8be5e5d95fad3f743d6a3b9ba30e5ad7e366cf0d70"} Jul 01 17:44:45.137025 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:44:45.136976 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rbfxs" podStartSLOduration=1.939239234 podStartE2EDuration="5.136962374s" totalImagesPullingTime="3.19772314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:44:45.136709205 +0000 UTC m=+345.129978400" watchObservedRunningTime="2026-07-01 17:44:45.136962374 +0000 UTC m=+345.130231566" Jul 01 17:45:04.889098 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.889012 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd"] Jul 01 17:45:04.892436 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.892420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:04.898803 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.898579 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 17:45:04.898803 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.898579 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xz94q\"" Jul 01 17:45:04.898928 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.898866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 17:45:04.899000 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.898974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 17:45:04.900612 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.900594 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 17:45:04.945790 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.945768 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd"] Jul 01 17:45:04.989858 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.989833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:04.989984 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.989880 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:04.989984 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.989900 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:04.989984 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.989959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tt5s\" (UniqueName: \"kubernetes.io/projected/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-kube-api-access-4tt5s\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:04.990107 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:04.990022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091231 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091323 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tt5s\" (UniqueName: \"kubernetes.io/projected/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-kube-api-access-4tt5s\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.091782 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.091751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-manifests\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.093680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.093646 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-tmp\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.093795 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.093778 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.093866 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.093844 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.129505 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.129474 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tt5s\" (UniqueName: \"kubernetes.io/projected/f5b9aadf-a1a0-4225-9b0f-c2fd619e5458-kube-api-access-4tt5s\") pod \"opendatahub-operator-controller-manager-66c9b6b59-t65kd\" (UID: \"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458\") " pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.201818 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.201760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:05.483225 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:05.483124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd"] Jul 01 17:45:05.525174 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:45:05.525136 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b9aadf_a1a0_4225_9b0f_c2fd619e5458.slice/crio-427a258c544e6eee29ce58c04fc6b098e78a68cb76e5a7cd4bd9a3ce6aa8639c WatchSource:0}: Error finding container 427a258c544e6eee29ce58c04fc6b098e78a68cb76e5a7cd4bd9a3ce6aa8639c: Status 404 returned error can't find the container with id 427a258c544e6eee29ce58c04fc6b098e78a68cb76e5a7cd4bd9a3ce6aa8639c Jul 01 17:45:06.199027 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:06.198989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" event={"ID":"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458","Type":"ContainerStarted","Data":"427a258c544e6eee29ce58c04fc6b098e78a68cb76e5a7cd4bd9a3ce6aa8639c"} Jul 01 17:45:10.222479 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:10.222436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" event={"ID":"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458","Type":"ContainerStarted","Data":"32c7efaee5b04a9488ddccecbe90186ab6e12b5959030193c9f4116f20b65694"} Jul 01 17:45:11.227758 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:11.227722 2582 generic.go:356] "Generic (PLEG): container finished" podID="f5b9aadf-a1a0-4225-9b0f-c2fd619e5458" containerID="32c7efaee5b04a9488ddccecbe90186ab6e12b5959030193c9f4116f20b65694" exitCode=0 Jul 01 17:45:11.228213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:11.227808 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" event={"ID":"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458","Type":"ContainerDied","Data":"32c7efaee5b04a9488ddccecbe90186ab6e12b5959030193c9f4116f20b65694"} Jul 01 17:45:12.234789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:12.234747 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" event={"ID":"f5b9aadf-a1a0-4225-9b0f-c2fd619e5458","Type":"ContainerStarted","Data":"30fa70a857e2c40473ae855149502d87e8383b20f7dc2f908634eb8346a8d410"} Jul 01 17:45:12.235243 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:12.234875 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:12.306293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:12.306243 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" podStartSLOduration=3.115713791 podStartE2EDuration="8.306227571s" totalImagesPullingTime="4.20141186s" totalInitContainerRuntime="989.10192ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:12.3049548 +0000 UTC m=+372.298223982" watchObservedRunningTime="2026-07-01 17:45:12.306227571 +0000 UTC m=+372.299496762" Jul 01 17:45:23.242098 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:23.242065 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66c9b6b59-t65kd" Jul 01 17:45:28.227332 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.227301 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-55chs"] Jul 01 17:45:28.230674 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.230657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.234030 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.234010 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 01 17:45:28.273064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.273042 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-55chs"] Jul 01 17:45:28.282851 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.282827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45fq\" (UniqueName: \"kubernetes.io/projected/4b00f08f-7de3-443c-b30b-5375441adbcb-kube-api-access-j45fq\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.282958 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.282875 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.383825 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.383801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45fq\" (UniqueName: \"kubernetes.io/projected/4b00f08f-7de3-443c-b30b-5375441adbcb-kube-api-access-j45fq\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.383973 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.383834 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.383973 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:45:28.383928 2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 17:45:28.384050 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:45:28.383990 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs podName:4b00f08f-7de3-443c-b30b-5375441adbcb nodeName:}" failed. No retries permitted until 2026-07-01 17:45:28.883974788 +0000 UTC m=+388.877243959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs") pod "model-serving-api-5dd488fc48-55chs" (UID: "4b00f08f-7de3-443c-b30b-5375441adbcb") : secret "model-serving-api-tls" not found Jul 01 17:45:28.418261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.418234 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45fq\" (UniqueName: \"kubernetes.io/projected/4b00f08f-7de3-443c-b30b-5375441adbcb-kube-api-access-j45fq\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.888906 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.888875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:28.891211 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:28.891185 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b00f08f-7de3-443c-b30b-5375441adbcb-tls-certs\") pod \"model-serving-api-5dd488fc48-55chs\" (UID: \"4b00f08f-7de3-443c-b30b-5375441adbcb\") " pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:29.141065 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:29.140981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:29.526099 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:29.526069 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-55chs"] Jul 01 17:45:29.528607 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:45:29.528582 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b00f08f_7de3_443c_b30b_5375441adbcb.slice/crio-e805fbc1711475bcece1c9707562b892faa3a03a9a26556e92c5e44b71bd2508 WatchSource:0}: Error finding container e805fbc1711475bcece1c9707562b892faa3a03a9a26556e92c5e44b71bd2508: Status 404 returned error can't find the container with id e805fbc1711475bcece1c9707562b892faa3a03a9a26556e92c5e44b71bd2508 Jul 01 17:45:30.314406 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:30.314360 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-55chs" event={"ID":"4b00f08f-7de3-443c-b30b-5375441adbcb","Type":"ContainerStarted","Data":"e805fbc1711475bcece1c9707562b892faa3a03a9a26556e92c5e44b71bd2508"} Jul 01 17:45:32.324091 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:32.324050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-55chs" event={"ID":"4b00f08f-7de3-443c-b30b-5375441adbcb","Type":"ContainerStarted","Data":"1f62323ed2ee3e743a70aeaa988613917a35fba61d4c278ec28b5797db0d1af5"} Jul 01 17:45:32.324478 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:32.324188 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:32.366104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:32.366013 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-55chs" podStartSLOduration=1.809897036 podStartE2EDuration="4.365997839s" totalImagesPullingTime="2.556100803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:32.365250345 +0000 UTC m=+392.358519537" watchObservedRunningTime="2026-07-01 17:45:32.365997839 +0000 UTC m=+392.359267031" Jul 01 17:45:34.873570 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.873541 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4"] Jul 01 17:45:34.876816 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.876800 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:34.883271 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.883071 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 17:45:34.883271 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.883071 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 17:45:34.883271 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.883087 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9l9s5\"" Jul 01 17:45:34.883459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.883311 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 17:45:34.901763 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.901742 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4"] Jul 01 17:45:34.946685 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.946653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5st\" (UniqueName: \"kubernetes.io/projected/981d9f11-e72a-43aa-949e-491c12c4f41b-kube-api-access-zm5st\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:34.946798 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.946699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:34.946798 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.946721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:34.946798 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:34.946774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/981d9f11-e72a-43aa-949e-491c12c4f41b-manager-config\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.048483 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.048443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5st\" (UniqueName: \"kubernetes.io/projected/981d9f11-e72a-43aa-949e-491c12c4f41b-kube-api-access-zm5st\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.048674 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.048508 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.048674 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.048534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.048674 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.048615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/981d9f11-e72a-43aa-949e-491c12c4f41b-manager-config\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.049526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.049497 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/981d9f11-e72a-43aa-949e-491c12c4f41b-manager-config\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.051220 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.051190 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-metrics-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.051345 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.051326 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981d9f11-e72a-43aa-949e-491c12c4f41b-cert\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.059242 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.059219 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5st\" (UniqueName: \"kubernetes.io/projected/981d9f11-e72a-43aa-949e-491c12c4f41b-kube-api-access-zm5st\") pod \"lws-controller-manager-6599c59cb5-vbvq4\" (UID: \"981d9f11-e72a-43aa-949e-491c12c4f41b\") " pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.186349 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.186270 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:35.430646 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:45:35.430619 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981d9f11_e72a_43aa_949e_491c12c4f41b.slice/crio-bfa0461fe10a0acaee3210c28cfee3b7cc0a9c046c8a073e493d51d03f4a58b6 WatchSource:0}: Error finding container bfa0461fe10a0acaee3210c28cfee3b7cc0a9c046c8a073e493d51d03f4a58b6: Status 404 returned error can't find the container with id bfa0461fe10a0acaee3210c28cfee3b7cc0a9c046c8a073e493d51d03f4a58b6 Jul 01 17:45:35.441317 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:35.441258 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4"] Jul 01 17:45:36.345554 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:36.345518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" event={"ID":"981d9f11-e72a-43aa-949e-491c12c4f41b","Type":"ContainerStarted","Data":"bfa0461fe10a0acaee3210c28cfee3b7cc0a9c046c8a073e493d51d03f4a58b6"} Jul 01 17:45:38.357906 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:38.357867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" event={"ID":"981d9f11-e72a-43aa-949e-491c12c4f41b","Type":"ContainerStarted","Data":"4c3037f139660a1ceaea348f6b71a84ba15806f3a9e2001b911093743404f820"} Jul 01 17:45:38.358390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:38.357987 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:38.492824 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:38.492773 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" podStartSLOduration=2.551355285 podStartE2EDuration="4.492758166s" totalImagesPullingTime="1.941402881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:38.492630367 +0000 UTC m=+398.485899560" watchObservedRunningTime="2026-07-01 17:45:38.492758166 +0000 UTC m=+398.486027358" Jul 01 17:45:43.332855 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:43.332826 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-55chs" Jul 01 17:45:49.364511 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:49.364481 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6599c59cb5-vbvq4" Jul 01 17:45:54.700507 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.700468 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5"] Jul 01 17:45:54.703690 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.703666 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.708402 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.708384 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 17:45:54.708488 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.708384 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7kp26\"" Jul 01 17:45:54.716412 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpd7g\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-kube-api-access-vpd7g\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9042b84f-0332-4a73-89e9-c0fb78f60295-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716738 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716738 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716738 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.716837 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.716749 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817123 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817123 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpd7g\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-kube-api-access-vpd7g\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817419 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9042b84f-0332-4a73-89e9-c0fb78f60295-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817419 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817419 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817677 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817641 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817766 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817837 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.817837 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.817768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.818158 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.818137 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9042b84f-0332-4a73-89e9-c0fb78f60295-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.819442 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.819421 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.819767 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.819750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.836972 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.836952 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.851819 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.851802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpd7g\" (UniqueName: \"kubernetes.io/projected/9042b84f-0332-4a73-89e9-c0fb78f60295-kube-api-access-vpd7g\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dxtlk5\" (UID: \"9042b84f-0332-4a73-89e9-c0fb78f60295\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:54.913645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:54.913615 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5"] Jul 01 17:45:55.013926 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:55.013853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:45:55.262486 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:55.262451 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5"] Jul 01 17:45:55.265230 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:45:55.265170 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9042b84f_0332_4a73_89e9_c0fb78f60295.slice/crio-68d2c2984dcfe72904cc4039c45f186170367e63070d15e4cf6fa40959e168d9 WatchSource:0}: Error finding container 68d2c2984dcfe72904cc4039c45f186170367e63070d15e4cf6fa40959e168d9: Status 404 returned error can't find the container with id 68d2c2984dcfe72904cc4039c45f186170367e63070d15e4cf6fa40959e168d9 Jul 01 17:45:55.436219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:55.436184 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" event={"ID":"9042b84f-0332-4a73-89e9-c0fb78f60295","Type":"ContainerStarted","Data":"68d2c2984dcfe72904cc4039c45f186170367e63070d15e4cf6fa40959e168d9"} Jul 01 17:45:58.596121 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.596089 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7d7598f5dc-6kdg9"] Jul 01 17:45:58.603226 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.603204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.611402 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.611367 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 17:45:58.611530 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.611506 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-q4dc7\"" Jul 01 17:45:58.621430 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.621411 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d7598f5dc-6kdg9"] Jul 01 17:45:58.651095 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.651061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a99002d4-2249-4187-bcc7-f1993f123fd2-redirect-config\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.651249 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.651121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dw7c\" (UniqueName: \"kubernetes.io/projected/a99002d4-2249-4187-bcc7-f1993f123fd2-kube-api-access-5dw7c\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.752319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.752289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a99002d4-2249-4187-bcc7-f1993f123fd2-redirect-config\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.752503 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.752329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dw7c\" (UniqueName: \"kubernetes.io/projected/a99002d4-2249-4187-bcc7-f1993f123fd2-kube-api-access-5dw7c\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.753234 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.753209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a99002d4-2249-4187-bcc7-f1993f123fd2-redirect-config\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.829562 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.829535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dw7c\" (UniqueName: \"kubernetes.io/projected/a99002d4-2249-4187-bcc7-f1993f123fd2-kube-api-access-5dw7c\") pod \"dashboard-redirect-7d7598f5dc-6kdg9\" (UID: \"a99002d4-2249-4187-bcc7-f1993f123fd2\") " pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:58.916534 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:58.916456 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" Jul 01 17:45:59.339094 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.339059 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:45:59.339191 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.339132 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:45:59.339191 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.339160 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:45:59.461477 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.461436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" event={"ID":"9042b84f-0332-4a73-89e9-c0fb78f60295","Type":"ContainerStarted","Data":"038c412f07252ed6b65b82de3a2b75f8d877005881ffe3f2322887d1681bd9f0"} Jul 01 17:45:59.507812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.507782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7d7598f5dc-6kdg9"] Jul 01 17:45:59.509372 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:45:59.509336 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99002d4_2249_4187_bcc7_f1993f123fd2.slice/crio-799d2d6e045749fb05d1d0bf0a000e65117c7027b006708f8d2f1b53e68fb048 WatchSource:0}: Error finding container 799d2d6e045749fb05d1d0bf0a000e65117c7027b006708f8d2f1b53e68fb048: Status 404 returned error can't find the container with id 799d2d6e045749fb05d1d0bf0a000e65117c7027b006708f8d2f1b53e68fb048 Jul 01 17:45:59.579152 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:45:59.579100 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" podStartSLOduration=1.5075485180000001 podStartE2EDuration="5.579084384s" totalImagesPullingTime="4.071535866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:45:59.573499743 +0000 UTC m=+419.566768934" watchObservedRunningTime="2026-07-01 17:45:59.579084384 +0000 UTC m=+419.572353576" Jul 01 17:46:00.014081 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:00.013979 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:46:00.015591 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:00.015553 2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 01 17:46:00.015710 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:00.015623 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" podUID="9042b84f-0332-4a73-89e9-c0fb78f60295" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 01 17:46:00.472228 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:00.472192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" event={"ID":"a99002d4-2249-4187-bcc7-f1993f123fd2","Type":"ContainerStarted","Data":"799d2d6e045749fb05d1d0bf0a000e65117c7027b006708f8d2f1b53e68fb048"} Jul 01 17:46:01.019075 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:01.019043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:46:01.476872 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:01.476819 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:46:01.478144 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:01.478122 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dxtlk5" Jul 01 17:46:04.494145 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:04.494101 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" event={"ID":"a99002d4-2249-4187-bcc7-f1993f123fd2","Type":"ContainerStarted","Data":"b3951b48b0777784d881cc1e23e3255804f61de167d491469c875f36c344c12f"} Jul 01 17:46:04.536612 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:04.536563 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7d7598f5dc-6kdg9" podStartSLOduration=2.051256723 podStartE2EDuration="6.53654837s" totalImagesPullingTime="4.485291647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:46:04.526313744 +0000 UTC m=+424.519582936" watchObservedRunningTime="2026-07-01 17:46:04.53654837 +0000 UTC m=+424.529817561" Jul 01 17:46:16.823171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.823143 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76df69f9cf-7sdkr"] Jul 01 17:46:16.831922 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.831824 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.841428 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:46:16.841399 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-76df69f9cf-7sdkr\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="f2273874-7ce2-4795-94de-c721bdceda51" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.887219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.887191 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76df69f9cf-7sdkr"] Jul 01 17:46:16.912622 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-console-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912724 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-service-ca\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912724 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912802 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-trusted-ca-bundle\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912802 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-oauth-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912882 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/f2273874-7ce2-4795-94de-c721bdceda51-kube-api-access-86zwj\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:16.912882 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:16.912862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-oauth-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013677 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-oauth-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-console-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-service-ca\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-trusted-ca-bundle\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.013828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-oauth-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.014099 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.013854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/f2273874-7ce2-4795-94de-c721bdceda51-kube-api-access-86zwj\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.014459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.014428 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-oauth-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.014562 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.014503 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-console-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.014637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.014613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-service-ca\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.014709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.014693 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2273874-7ce2-4795-94de-c721bdceda51-trusted-ca-bundle\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.016315 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.016289 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-oauth-config\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.016408 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.016365 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2273874-7ce2-4795-94de-c721bdceda51-console-serving-cert\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.049272 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.049242 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86zwj\" (UniqueName: \"kubernetes.io/projected/f2273874-7ce2-4795-94de-c721bdceda51-kube-api-access-86zwj\") pod \"console-76df69f9cf-7sdkr\" (UID: \"f2273874-7ce2-4795-94de-c721bdceda51\") " pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.141023 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.140933 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:17.310283 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.310247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76df69f9cf-7sdkr"] Jul 01 17:46:17.317878 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:46:17.317851 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2273874_7ce2_4795_94de_c721bdceda51.slice/crio-43bc00d783d2a8a8b925709a80cdc29008814f6a00d7ba0c1990506b8df2811e WatchSource:0}: Error finding container 43bc00d783d2a8a8b925709a80cdc29008814f6a00d7ba0c1990506b8df2811e: Status 404 returned error can't find the container with id 43bc00d783d2a8a8b925709a80cdc29008814f6a00d7ba0c1990506b8df2811e Jul 01 17:46:17.552525 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.552491 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76df69f9cf-7sdkr" event={"ID":"f2273874-7ce2-4795-94de-c721bdceda51","Type":"ContainerStarted","Data":"b34ded1953255604d24a147457dc006b4c33783a28701734db7fcbb704c23c8b"} Jul 01 17:46:17.552696 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.552540 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76df69f9cf-7sdkr" event={"ID":"f2273874-7ce2-4795-94de-c721bdceda51","Type":"ContainerStarted","Data":"43bc00d783d2a8a8b925709a80cdc29008814f6a00d7ba0c1990506b8df2811e"} Jul 01 17:46:17.621405 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:17.621358 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76df69f9cf-7sdkr" podStartSLOduration=1.6213439269999999 podStartE2EDuration="1.621343927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:46:17.621026733 +0000 UTC m=+437.614295927" watchObservedRunningTime="2026-07-01 17:46:17.621343927 +0000 UTC m=+437.614613119" Jul 01 17:46:27.141479 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:27.141389 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:27.141479 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:27.141476 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:27.146001 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:27.145982 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:27.603045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:27.603003 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76df69f9cf-7sdkr" Jul 01 17:46:27.838563 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:27.838529 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:46:28.015065 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.014986 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ssbl"] Jul 01 17:46:28.018900 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.018860 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:28.051064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.051038 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ssbl"] Jul 01 17:46:28.053065 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.053042 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 17:46:28.053201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.053042 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 17:46:28.053201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.053044 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-b4xkd\"" Jul 01 17:46:28.113668 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.113641 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zlz\" (UniqueName: \"kubernetes.io/projected/4875d026-b47e-4d05-9bd3-e46a0cc182f7-kube-api-access-k7zlz\") pod \"kuadrant-operator-catalog-8ssbl\" (UID: \"4875d026-b47e-4d05-9bd3-e46a0cc182f7\") " pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:28.214818 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.214788 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zlz\" (UniqueName: \"kubernetes.io/projected/4875d026-b47e-4d05-9bd3-e46a0cc182f7-kube-api-access-k7zlz\") pod \"kuadrant-operator-catalog-8ssbl\" (UID: \"4875d026-b47e-4d05-9bd3-e46a0cc182f7\") " pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:28.268230 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.268163 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zlz\" (UniqueName: \"kubernetes.io/projected/4875d026-b47e-4d05-9bd3-e46a0cc182f7-kube-api-access-k7zlz\") pod \"kuadrant-operator-catalog-8ssbl\" (UID: \"4875d026-b47e-4d05-9bd3-e46a0cc182f7\") " pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:28.329252 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.329220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:28.482901 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.482877 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ssbl"] Jul 01 17:46:28.485251 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:46:28.485222 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4875d026_b47e_4d05_9bd3_e46a0cc182f7.slice/crio-77f962259c95408c2b072e0cccb5bdd1812aba95a7df74f775dd274428f00ed7 WatchSource:0}: Error finding container 77f962259c95408c2b072e0cccb5bdd1812aba95a7df74f775dd274428f00ed7: Status 404 returned error can't find the container with id 77f962259c95408c2b072e0cccb5bdd1812aba95a7df74f775dd274428f00ed7 Jul 01 17:46:28.603794 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:28.603761 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" event={"ID":"4875d026-b47e-4d05-9bd3-e46a0cc182f7","Type":"ContainerStarted","Data":"77f962259c95408c2b072e0cccb5bdd1812aba95a7df74f775dd274428f00ed7"} Jul 01 17:46:32.623586 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:32.623543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" event={"ID":"4875d026-b47e-4d05-9bd3-e46a0cc182f7","Type":"ContainerStarted","Data":"9ba6fb9425821cc8c0626e5375d34417f9b4cbcfb40418c941483e27e8f7a126"} Jul 01 17:46:32.676425 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:32.676376 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" podStartSLOduration=2.268108663 podStartE2EDuration="5.676361872s" totalImagesPullingTime="3.408253209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:46:32.670525753 +0000 UTC m=+452.663794944" watchObservedRunningTime="2026-07-01 17:46:32.676361872 +0000 UTC m=+452.669631064" Jul 01 17:46:38.329442 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:38.329403 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:38.329839 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:38.329458 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:38.352266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:38.352242 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:38.673187 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:38.673103 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8ssbl" Jul 01 17:46:52.859248 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:52.859195 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb866ff7b-6t5n7" podUID="39ba33e6-afa9-4c03-a922-0ea5f454a172" containerName="console" containerID="cri-o://3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b" gracePeriod=15 Jul 01 17:46:53.114379 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.114319 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:46:53.240466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240436 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pwnp\" (UniqueName: \"kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240466 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240466 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240754 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240501 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240754 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240546 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240754 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240606 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240754 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240638 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.240754 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.240665 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert\") pod \"39ba33e6-afa9-4c03-a922-0ea5f454a172\" (UID: \"39ba33e6-afa9-4c03-a922-0ea5f454a172\") " Jul 01 17:46:53.241039 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.241014 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config" (OuterVolumeSpecName: "console-config") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:46:53.241148 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.241116 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca" (OuterVolumeSpecName: "service-ca") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:46:53.241216 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.241153 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:46:53.241268 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.241219 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:46:53.242697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.242668 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:46:53.242697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.242685 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp" (OuterVolumeSpecName: "kube-api-access-9pwnp") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "kube-api-access-9pwnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:46:53.242897 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.242882 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39ba33e6-afa9-4c03-a922-0ea5f454a172" (UID: "39ba33e6-afa9-4c03-a922-0ea5f454a172"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:46:53.342161 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342136 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-trusted-ca-bundle\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342161 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342158 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-service-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342161 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342167 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-oauth-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342175 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pwnp\" (UniqueName: \"kubernetes.io/projected/39ba33e6-afa9-4c03-a922-0ea5f454a172-kube-api-access-9pwnp\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342185 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342193 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-serving-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.342350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.342202 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39ba33e6-afa9-4c03-a922-0ea5f454a172-console-oauth-config\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:46:53.716213 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.716179 2582 generic.go:356] "Generic (PLEG): container finished" podID="39ba33e6-afa9-4c03-a922-0ea5f454a172" containerID="3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b" exitCode=0 Jul 01 17:46:53.716383 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.716220 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb866ff7b-6t5n7" Jul 01 17:46:53.716383 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.716257 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb866ff7b-6t5n7" event={"ID":"39ba33e6-afa9-4c03-a922-0ea5f454a172","Type":"ContainerDied","Data":"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b"} Jul 01 17:46:53.716383 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.716298 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb866ff7b-6t5n7" event={"ID":"39ba33e6-afa9-4c03-a922-0ea5f454a172","Type":"ContainerDied","Data":"ed1d08e87e24673e40cbcd8967fe7d3a664f19f3fa36e1e894f0b31b4e4292d9"} Jul 01 17:46:53.716383 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.716318 2582 scope.go:117] "RemoveContainer" containerID="3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b" Jul 01 17:46:53.725634 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.725615 2582 scope.go:117] "RemoveContainer" containerID="3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b" Jul 01 17:46:53.725853 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:46:53.725837 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b\": container with ID starting with 3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b not found: ID does not exist" containerID="3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b" Jul 01 17:46:53.725903 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.725861 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b"} err="failed to get container status \"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b\": rpc error: code = NotFound desc = could not find container \"3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b\": container with ID starting with 3a88dc1e7acfa0e5c84e796225cd2f353c62bef5f1d6b691cd6cbdb3620e664b not found: ID does not exist" Jul 01 17:46:53.749862 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.749836 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:46:53.759495 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:53.759475 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb866ff7b-6t5n7"] Jul 01 17:46:54.646922 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:46:54.646888 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39ba33e6-afa9-4c03-a922-0ea5f454a172" path="/var/lib/kubelet/pods/39ba33e6-afa9-4c03-a922-0ea5f454a172/volumes" Jul 01 17:47:01.662953 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.662908 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n"] Jul 01 17:47:01.663340 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.663273 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39ba33e6-afa9-4c03-a922-0ea5f454a172" containerName="console" Jul 01 17:47:01.663340 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.663286 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39ba33e6-afa9-4c03-a922-0ea5f454a172" containerName="console" Jul 01 17:47:01.663415 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.663382 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39ba33e6-afa9-4c03-a922-0ea5f454a172" containerName="console" Jul 01 17:47:01.671054 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.671035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:01.674285 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.674262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7t95p\"" Jul 01 17:47:01.679219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.679199 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n"] Jul 01 17:47:01.717400 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.717366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlkrq\" (UniqueName: \"kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq\") pod \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" (UID: \"bcc2e030-d48b-473e-9c33-7389bb6bc542\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:01.818632 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.818586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlkrq\" (UniqueName: \"kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq\") pod \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" (UID: \"bcc2e030-d48b-473e-9c33-7389bb6bc542\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:01.836150 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.836115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlkrq\" (UniqueName: \"kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq\") pod \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" (UID: \"bcc2e030-d48b-473e-9c33-7389bb6bc542\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:01.981873 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:01.981781 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:02.147130 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:02.147066 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n"] Jul 01 17:47:02.149825 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:47:02.149798 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc2e030_d48b_473e_9c33_7389bb6bc542.slice/crio-f7ae7f2ffa32a1e10435d13eab09ef17bc4865b1899e06ea798424780c5e8ae5 WatchSource:0}: Error finding container f7ae7f2ffa32a1e10435d13eab09ef17bc4865b1899e06ea798424780c5e8ae5: Status 404 returned error can't find the container with id f7ae7f2ffa32a1e10435d13eab09ef17bc4865b1899e06ea798424780c5e8ae5 Jul 01 17:47:02.757509 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:02.757472 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" event={"ID":"bcc2e030-d48b-473e-9c33-7389bb6bc542","Type":"ContainerStarted","Data":"f7ae7f2ffa32a1e10435d13eab09ef17bc4865b1899e06ea798424780c5e8ae5"} Jul 01 17:47:04.769644 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:04.769602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" event={"ID":"bcc2e030-d48b-473e-9c33-7389bb6bc542","Type":"ContainerStarted","Data":"ae519dc247bf5b737083e5134cc36a82f1b8155c01799131d3c225e273ebadd8"} Jul 01 17:47:04.770062 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:04.769785 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:04.844753 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:04.844711 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" podStartSLOduration=1.895690027 podStartE2EDuration="3.844696987s" totalImagesPullingTime="1.94900696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:04.835786784 +0000 UTC m=+484.829055976" watchObservedRunningTime="2026-07-01 17:47:04.844696987 +0000 UTC m=+484.837966178" Jul 01 17:47:15.776303 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:15.776276 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:21.151517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.151488 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2"] Jul 01 17:47:21.155074 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.155058 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.165188 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.165163 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 17:47:21.165323 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.165207 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 17:47:21.175189 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.175171 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hpjjm\"" Jul 01 17:47:21.187298 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.187277 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2"] Jul 01 17:47:21.282448 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.282418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4pf6\" (UniqueName: \"kubernetes.io/projected/b67e9b6d-077e-4a53-9818-999f70866bb4-kube-api-access-x4pf6\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.282576 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.282468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b67e9b6d-077e-4a53-9818-999f70866bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.282576 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.282512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67e9b6d-077e-4a53-9818-999f70866bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.383184 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.383153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4pf6\" (UniqueName: \"kubernetes.io/projected/b67e9b6d-077e-4a53-9818-999f70866bb4-kube-api-access-x4pf6\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.383351 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.383197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b67e9b6d-077e-4a53-9818-999f70866bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.383351 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.383253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67e9b6d-077e-4a53-9818-999f70866bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.384006 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.383985 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b67e9b6d-077e-4a53-9818-999f70866bb4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.385736 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.385712 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67e9b6d-077e-4a53-9818-999f70866bb4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.400545 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.400517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4pf6\" (UniqueName: \"kubernetes.io/projected/b67e9b6d-077e-4a53-9818-999f70866bb4-kube-api-access-x4pf6\") pod \"kuadrant-console-plugin-66b5774985-bx8z2\" (UID: \"b67e9b6d-077e-4a53-9818-999f70866bb4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.466051 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.465988 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" Jul 01 17:47:21.606545 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.606514 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2"] Jul 01 17:47:21.606898 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:47:21.606878 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb67e9b6d_077e_4a53_9818_999f70866bb4.slice/crio-22d53b37bbd4217e577abdb3ead5ea377737e2eb7d1683834423ec353f9e7acb WatchSource:0}: Error finding container 22d53b37bbd4217e577abdb3ead5ea377737e2eb7d1683834423ec353f9e7acb: Status 404 returned error can't find the container with id 22d53b37bbd4217e577abdb3ead5ea377737e2eb7d1683834423ec353f9e7acb Jul 01 17:47:21.849860 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:21.849831 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" event={"ID":"b67e9b6d-077e-4a53-9818-999f70866bb4","Type":"ContainerStarted","Data":"22d53b37bbd4217e577abdb3ead5ea377737e2eb7d1683834423ec353f9e7acb"} Jul 01 17:47:31.798948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.798901 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n"] Jul 01 17:47:31.799517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.799148 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" containerName="manager" containerID="cri-o://ae519dc247bf5b737083e5134cc36a82f1b8155c01799131d3c225e273ebadd8" gracePeriod=2 Jul 01 17:47:31.813147 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.813116 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n"] Jul 01 17:47:31.835775 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:47:31.835725 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:31.867612 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.867577 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz"] Jul 01 17:47:31.868200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.868172 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" containerName="manager" Jul 01 17:47:31.868200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.868195 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" containerName="manager" Jul 01 17:47:31.868336 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.868306 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" containerName="manager" Jul 01 17:47:31.874822 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.874802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:31.880745 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:47:31.880708 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:31.887654 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.887626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlb5\" (UniqueName: \"kubernetes.io/projected/dd1e1864-9697-4e4c-bde2-d7f11fe3bd06-kube-api-access-5mlb5\") pod \"limitador-operator-controller-manager-859d7b78bd-xt6lz\" (UID: \"dd1e1864-9697-4e4c-bde2-d7f11fe3bd06\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:31.890768 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.890319 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz"] Jul 01 17:47:31.988439 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:31.988396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlb5\" (UniqueName: \"kubernetes.io/projected/dd1e1864-9697-4e4c-bde2-d7f11fe3bd06-kube-api-access-5mlb5\") pod \"limitador-operator-controller-manager-859d7b78bd-xt6lz\" (UID: \"dd1e1864-9697-4e4c-bde2-d7f11fe3bd06\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:32.022996 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:32.022961 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlb5\" (UniqueName: \"kubernetes.io/projected/dd1e1864-9697-4e4c-bde2-d7f11fe3bd06-kube-api-access-5mlb5\") pod \"limitador-operator-controller-manager-859d7b78bd-xt6lz\" (UID: \"dd1e1864-9697-4e4c-bde2-d7f11fe3bd06\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:32.195017 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:32.194981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:44.892412 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:44.892380 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz"] Jul 01 17:47:44.976358 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:44.976291 2582 generic.go:356] "Generic (PLEG): container finished" podID="bcc2e030-d48b-473e-9c33-7389bb6bc542" containerID="ae519dc247bf5b737083e5134cc36a82f1b8155c01799131d3c225e273ebadd8" exitCode=0 Jul 01 17:47:45.058303 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:47:45.058269 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1e1864_9697_4e4c_bde2_d7f11fe3bd06.slice/crio-cd3a49c933a0825ce621b4ed65b81d94162f192fce503588116800510ab23107 WatchSource:0}: Error finding container cd3a49c933a0825ce621b4ed65b81d94162f192fce503588116800510ab23107: Status 404 returned error can't find the container with id cd3a49c933a0825ce621b4ed65b81d94162f192fce503588116800510ab23107 Jul 01 17:47:45.095274 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.095253 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:45.097951 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:47:45.097912 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:45.218828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.218804 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlkrq\" (UniqueName: \"kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq\") pod \"bcc2e030-d48b-473e-9c33-7389bb6bc542\" (UID: \"bcc2e030-d48b-473e-9c33-7389bb6bc542\") " Jul 01 17:47:45.220739 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.220719 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq" (OuterVolumeSpecName: "kube-api-access-jlkrq") pod "bcc2e030-d48b-473e-9c33-7389bb6bc542" (UID: "bcc2e030-d48b-473e-9c33-7389bb6bc542"). InnerVolumeSpecName "kube-api-access-jlkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:47:45.319870 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.319844 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlkrq\" (UniqueName: \"kubernetes.io/projected/bcc2e030-d48b-473e-9c33-7389bb6bc542-kube-api-access-jlkrq\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:47:45.982232 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.982151 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" event={"ID":"dd1e1864-9697-4e4c-bde2-d7f11fe3bd06","Type":"ContainerStarted","Data":"3dcbae33f203f2cccb44b2a1e70eb82ae7c9d5a8b9054ebdc86887077cd292fa"} Jul 01 17:47:45.982232 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.982201 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" event={"ID":"dd1e1864-9697-4e4c-bde2-d7f11fe3bd06","Type":"ContainerStarted","Data":"cd3a49c933a0825ce621b4ed65b81d94162f192fce503588116800510ab23107"} Jul 01 17:47:45.982690 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.982325 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:47:45.983660 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.983636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" event={"ID":"b67e9b6d-077e-4a53-9818-999f70866bb4","Type":"ContainerStarted","Data":"7ee0254aefa73f60392c8f8f2f6c194f3067a1e1ffcf269b39fcb06fd54186f9"} Jul 01 17:47:45.984817 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.984800 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:45.984817 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:45.984815 2582 scope.go:117] "RemoveContainer" containerID="ae519dc247bf5b737083e5134cc36a82f1b8155c01799131d3c225e273ebadd8" Jul 01 17:47:46.032659 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:46.032588 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" podStartSLOduration=15.032571321 podStartE2EDuration="15.032571321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:46.032312087 +0000 UTC m=+526.025581279" watchObservedRunningTime="2026-07-01 17:47:46.032571321 +0000 UTC m=+526.025840512" Jul 01 17:47:46.041709 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:47:46.041682 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:46.073408 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:47:46.073378 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rqw5n\" is forbidden: User \"system:node:ip-10-0-143-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-173.ec2.internal' and this object" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rqw5n" Jul 01 17:47:46.073521 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:46.073465 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bx8z2" podStartSLOduration=1.193324081 podStartE2EDuration="25.073451584s" totalImagesPullingTime="23.880127503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:47:46.071042207 +0000 UTC m=+526.064311399" watchObservedRunningTime="2026-07-01 17:47:46.073451584 +0000 UTC m=+526.066720776" Jul 01 17:47:46.651108 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:46.648792 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc2e030-d48b-473e-9c33-7389bb6bc542" path="/var/lib/kubelet/pods/bcc2e030-d48b-473e-9c33-7389bb6bc542/volumes" Jul 01 17:47:56.992750 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:47:56.992678 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xt6lz" Jul 01 17:48:05.504024 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.503991 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx"] Jul 01 17:48:05.507044 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.507028 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.514161 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.514144 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-chrdl\"" Jul 01 17:48:05.529960 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.529924 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx"] Jul 01 17:48:05.699229 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699393 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699393 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699393 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699500 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699500 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699500 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpkvz\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-kube-api-access-lpkvz\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699603 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.699603 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.699541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1433dabf-dc03-4668-b518-52db3caf7d7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801026 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.800927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801026 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.800993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1433dabf-dc03-4668-b518-52db3caf7d7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801091 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801219 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801432 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801432 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801432 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpkvz\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-kube-api-access-lpkvz\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801432 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801398 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801731 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801835 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.801857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.801839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1433dabf-dc03-4668-b518-52db3caf7d7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.803600 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.803571 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.803694 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.803622 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.812319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.812299 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpkvz\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-kube-api-access-lpkvz\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.812889 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.812866 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1433dabf-dc03-4668-b518-52db3caf7d7d-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-qjxdx\" (UID: \"1433dabf-dc03-4668-b518-52db3caf7d7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.816892 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.816874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:05.950323 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.950293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx"] Jul 01 17:48:05.951344 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:48:05.951317 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1433dabf_dc03_4668_b518_52db3caf7d7d.slice/crio-3814c9894560ea18adbedbdda7e24d895e3e38feb722e26e4482e904b6b79b49 WatchSource:0}: Error finding container 3814c9894560ea18adbedbdda7e24d895e3e38feb722e26e4482e904b6b79b49: Status 404 returned error can't find the container with id 3814c9894560ea18adbedbdda7e24d895e3e38feb722e26e4482e904b6b79b49 Jul 01 17:48:05.953450 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.953418 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:48:05.953551 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.953504 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:48:05.953617 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:05.953556 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:48:06.082777 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:06.082744 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" event={"ID":"1433dabf-dc03-4668-b518-52db3caf7d7d","Type":"ContainerStarted","Data":"46cf029d72c2d1ad7324a6e63858a2521a3575a874b79159158b3a80b7e394f9"} Jul 01 17:48:06.082987 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:06.082806 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" event={"ID":"1433dabf-dc03-4668-b518-52db3caf7d7d","Type":"ContainerStarted","Data":"3814c9894560ea18adbedbdda7e24d895e3e38feb722e26e4482e904b6b79b49"} Jul 01 17:48:06.145999 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:06.145925 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" podStartSLOduration=1.145909754 podStartE2EDuration="1.145909754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:06.142324252 +0000 UTC m=+546.135593445" watchObservedRunningTime="2026-07-01 17:48:06.145909754 +0000 UTC m=+546.139178945" Jul 01 17:48:06.817625 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:06.817597 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:07.824259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:07.824229 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:08.092756 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.092692 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:08.093619 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.093590 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:48:08.465050 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.464977 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:08.590573 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.590547 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:08.590741 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.590638 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:08.595070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.595049 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k4kpr\"" Jul 01 17:48:08.625132 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.625105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8tl\" (UniqueName: \"kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl\") pod \"authorino-58cd955675-z6cwg\" (UID: \"0b64fb69-4e2b-41da-babc-3101e026fcc9\") " pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:08.726617 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.726544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8tl\" (UniqueName: \"kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl\") pod \"authorino-58cd955675-z6cwg\" (UID: \"0b64fb69-4e2b-41da-babc-3101e026fcc9\") " pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:08.743154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.743130 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8tl\" (UniqueName: \"kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl\") pod \"authorino-58cd955675-z6cwg\" (UID: \"0b64fb69-4e2b-41da-babc-3101e026fcc9\") " pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:08.900350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:08.900322 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:09.083917 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.083885 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:48:09.086675 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.086652 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:09.086812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.086753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:48:09.093081 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:48:09.093047 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b64fb69_4e2b_41da_babc_3101e026fcc9.slice/crio-906a52670abf77127817f3512ce4f856b22a50aece346dd2c8fac9e226e945f9 WatchSource:0}: Error finding container 906a52670abf77127817f3512ce4f856b22a50aece346dd2c8fac9e226e945f9: Status 404 returned error can't find the container with id 906a52670abf77127817f3512ce4f856b22a50aece346dd2c8fac9e226e945f9 Jul 01 17:48:09.129522 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.129494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7fll\" (UniqueName: \"kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll\") pod \"authorino-75d556bd77-p6j4r\" (UID: \"b0241bf6-3fd3-44c8-b892-1bf560c0504d\") " pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:48:09.179339 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.179314 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:48:09.230491 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.230466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7fll\" (UniqueName: \"kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll\") pod \"authorino-75d556bd77-p6j4r\" (UID: \"b0241bf6-3fd3-44c8-b892-1bf560c0504d\") " pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:48:09.246071 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.246017 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7fll\" (UniqueName: \"kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll\") pod \"authorino-75d556bd77-p6j4r\" (UID: \"b0241bf6-3fd3-44c8-b892-1bf560c0504d\") " pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:48:09.405778 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.405739 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:48:09.539676 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:09.539653 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:48:09.540979 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:48:09.540929 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0241bf6_3fd3_44c8_b892_1bf560c0504d.slice/crio-63703e2a298794c925bb50c967ec8963543e7fcbdff792cae327683b0657f82d WatchSource:0}: Error finding container 63703e2a298794c925bb50c967ec8963543e7fcbdff792cae327683b0657f82d: Status 404 returned error can't find the container with id 63703e2a298794c925bb50c967ec8963543e7fcbdff792cae327683b0657f82d Jul 01 17:48:10.106335 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:10.106273 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6cwg" event={"ID":"0b64fb69-4e2b-41da-babc-3101e026fcc9","Type":"ContainerStarted","Data":"906a52670abf77127817f3512ce4f856b22a50aece346dd2c8fac9e226e945f9"} Jul 01 17:48:10.107822 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:10.107788 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p6j4r" event={"ID":"b0241bf6-3fd3-44c8-b892-1bf560c0504d","Type":"ContainerStarted","Data":"63703e2a298794c925bb50c967ec8963543e7fcbdff792cae327683b0657f82d"} Jul 01 17:48:13.129986 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:13.129918 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6cwg" event={"ID":"0b64fb69-4e2b-41da-babc-3101e026fcc9","Type":"ContainerStarted","Data":"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347"} Jul 01 17:48:15.141828 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.141788 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p6j4r" event={"ID":"b0241bf6-3fd3-44c8-b892-1bf560c0504d","Type":"ContainerStarted","Data":"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4"} Jul 01 17:48:15.162914 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.162864 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p6j4r" podStartSLOduration=1.074544796 podStartE2EDuration="6.162851565s" totalImagesPullingTime="5.088306769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:15.160970838 +0000 UTC m=+555.154240029" watchObservedRunningTime="2026-07-01 17:48:15.162851565 +0000 UTC m=+555.156120758" Jul 01 17:48:15.163070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.163024 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z6cwg" podStartSLOduration=3.281063128 podStartE2EDuration="7.163017001s" totalImagesPullingTime="3.881953873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:48:13.155363386 +0000 UTC m=+553.148632578" watchObservedRunningTime="2026-07-01 17:48:15.163017001 +0000 UTC m=+555.156286201" Jul 01 17:48:15.214513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.214477 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:15.214691 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.214666 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z6cwg" podUID="0b64fb69-4e2b-41da-babc-3101e026fcc9" containerName="authorino" containerID="cri-o://ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347" gracePeriod=30 Jul 01 17:48:15.494116 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.494089 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:15.593371 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.593343 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p8tl\" (UniqueName: \"kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl\") pod \"0b64fb69-4e2b-41da-babc-3101e026fcc9\" (UID: \"0b64fb69-4e2b-41da-babc-3101e026fcc9\") " Jul 01 17:48:15.595424 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.595395 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl" (OuterVolumeSpecName: "kube-api-access-5p8tl") pod "0b64fb69-4e2b-41da-babc-3101e026fcc9" (UID: "0b64fb69-4e2b-41da-babc-3101e026fcc9"). InnerVolumeSpecName "kube-api-access-5p8tl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:48:15.694168 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:15.694133 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p8tl\" (UniqueName: \"kubernetes.io/projected/0b64fb69-4e2b-41da-babc-3101e026fcc9-kube-api-access-5p8tl\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:48:16.148263 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.148224 2582 generic.go:356] "Generic (PLEG): container finished" podID="0b64fb69-4e2b-41da-babc-3101e026fcc9" containerID="ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347" exitCode=0 Jul 01 17:48:16.148695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.148281 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z6cwg" Jul 01 17:48:16.148695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.148313 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6cwg" event={"ID":"0b64fb69-4e2b-41da-babc-3101e026fcc9","Type":"ContainerDied","Data":"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347"} Jul 01 17:48:16.148695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.148361 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z6cwg" event={"ID":"0b64fb69-4e2b-41da-babc-3101e026fcc9","Type":"ContainerDied","Data":"906a52670abf77127817f3512ce4f856b22a50aece346dd2c8fac9e226e945f9"} Jul 01 17:48:16.148695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.148385 2582 scope.go:117] "RemoveContainer" containerID="ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347" Jul 01 17:48:16.157450 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.157433 2582 scope.go:117] "RemoveContainer" containerID="ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347" Jul 01 17:48:16.157685 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:48:16.157668 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347\": container with ID starting with ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347 not found: ID does not exist" containerID="ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347" Jul 01 17:48:16.157739 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.157693 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347"} err="failed to get container status \"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347\": rpc error: code = NotFound desc = could not find container \"ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347\": container with ID starting with ca63b862642588e93ae79fa766b59e7f78a21ea975ce2d6e211b2feb4ab33347 not found: ID does not exist" Jul 01 17:48:16.172787 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.172770 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:16.178167 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.178149 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z6cwg"] Jul 01 17:48:16.647328 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:48:16.647300 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b64fb69-4e2b-41da-babc-3101e026fcc9" path="/var/lib/kubelet/pods/0b64fb69-4e2b-41da-babc-3101e026fcc9/volumes" Jul 01 17:49:00.506582 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:00.506553 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:49:00.508377 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:00.508357 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:49:00.511534 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:00.511518 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:49:00.513276 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:00.513259 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:49:08.747638 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.747608 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:49:08.748052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.747978 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b64fb69-4e2b-41da-babc-3101e026fcc9" containerName="authorino" Jul 01 17:49:08.748052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.747989 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b64fb69-4e2b-41da-babc-3101e026fcc9" containerName="authorino" Jul 01 17:49:08.748052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.748045 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b64fb69-4e2b-41da-babc-3101e026fcc9" containerName="authorino" Jul 01 17:49:08.750572 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.750555 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:08.757000 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.756833 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 17:49:08.757331 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.757313 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dl4lt\"" Jul 01 17:49:08.758095 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.758079 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 17:49:08.758191 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.758086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 17:49:08.779732 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.779710 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:49:08.879526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.879496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs8hk\" (UniqueName: \"kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk\") pod \"maas-keycloak-0\" (UID: \"211e49e5-90ca-4a4c-a583-946672b06bde\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:08.980385 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.980348 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8hk\" (UniqueName: \"kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk\") pod \"maas-keycloak-0\" (UID: \"211e49e5-90ca-4a4c-a583-946672b06bde\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:08.994792 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:08.994760 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8hk\" (UniqueName: \"kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk\") pod \"maas-keycloak-0\" (UID: \"211e49e5-90ca-4a4c-a583-946672b06bde\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:09.059847 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:09.059826 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:09.201791 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:09.201769 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:49:09.203909 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:09.203887 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211e49e5_90ca_4a4c_a583_946672b06bde.slice/crio-4e046da071b7d7f6d3059cde6a830459d575ac87bbfdf1e82277525a2c091087 WatchSource:0}: Error finding container 4e046da071b7d7f6d3059cde6a830459d575ac87bbfdf1e82277525a2c091087: Status 404 returned error can't find the container with id 4e046da071b7d7f6d3059cde6a830459d575ac87bbfdf1e82277525a2c091087 Jul 01 17:49:09.401014 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:09.400922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"211e49e5-90ca-4a4c-a583-946672b06bde","Type":"ContainerStarted","Data":"4e046da071b7d7f6d3059cde6a830459d575ac87bbfdf1e82277525a2c091087"} Jul 01 17:49:15.441648 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:15.441604 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"211e49e5-90ca-4a4c-a583-946672b06bde","Type":"ContainerStarted","Data":"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90"} Jul 01 17:49:15.471849 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:15.471793 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.146690033 podStartE2EDuration="7.471776242s" totalImagesPullingTime="5.325086209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:15.468894334 +0000 UTC m=+615.462163527" watchObservedRunningTime="2026-07-01 17:49:15.471776242 +0000 UTC m=+615.465045434" Jul 01 17:49:16.060515 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:16.060473 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:16.062695 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:16.062655 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:17.060368 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:17.060322 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:18.060826 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:18.060764 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:19.060847 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:19.060801 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:19.061509 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:19.061466 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:20.061244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:20.061183 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:21.060619 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:21.060573 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:22.060971 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:22.060899 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:23.060209 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:23.060165 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:24.060760 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:24.060708 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:25.061325 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:25.061274 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:26.060806 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:26.060754 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:27.060951 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:27.060896 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.40:9000/health/started\": dial tcp 10.133.0.40:9000: connect: connection refused" Jul 01 17:49:28.185104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:28.185067 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:28.203335 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:28.203294 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:49:38.191551 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:38.191519 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 17:49:39.166700 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.166661 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:39.168995 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.168975 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:39.180236 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.180215 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:39.291347 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.291312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d99ds\" (UniqueName: \"kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds\") pod \"authorino-5d4b67c446-np442\" (UID: \"4b5e8eac-42ff-402b-8253-d0caf2f255f6\") " pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:39.392036 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.391998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d99ds\" (UniqueName: \"kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds\") pod \"authorino-5d4b67c446-np442\" (UID: \"4b5e8eac-42ff-402b-8253-d0caf2f255f6\") " pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:39.410515 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.410482 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d99ds\" (UniqueName: \"kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds\") pod \"authorino-5d4b67c446-np442\" (UID: \"4b5e8eac-42ff-402b-8253-d0caf2f255f6\") " pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:39.444488 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.444421 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:39.444709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.444697 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:39.483777 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.483749 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:39.486109 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.486094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:39.503372 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.503347 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:39.591576 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.591538 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:39.592643 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:39.592613 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5e8eac_42ff_402b_8253_d0caf2f255f6.slice/crio-f2f117e8371ad43cf29002c4893bf6ffbaf88d3cb546ed85d3797bf44ea8c5b8 WatchSource:0}: Error finding container f2f117e8371ad43cf29002c4893bf6ffbaf88d3cb546ed85d3797bf44ea8c5b8: Status 404 returned error can't find the container with id f2f117e8371ad43cf29002c4893bf6ffbaf88d3cb546ed85d3797bf44ea8c5b8 Jul 01 17:49:39.593670 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.593646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxpgh\" (UniqueName: \"kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh\") pod \"authorino-7457494f9b-bfm77\" (UID: \"4cb68f0b-85b8-4ced-b248-3731653ace52\") " pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:39.594013 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.594000 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:49:39.606012 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.605986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-np442" event={"ID":"4b5e8eac-42ff-402b-8253-d0caf2f255f6","Type":"ContainerStarted","Data":"f2f117e8371ad43cf29002c4893bf6ffbaf88d3cb546ed85d3797bf44ea8c5b8"} Jul 01 17:49:39.694747 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.694663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxpgh\" (UniqueName: \"kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh\") pod \"authorino-7457494f9b-bfm77\" (UID: \"4cb68f0b-85b8-4ced-b248-3731653ace52\") " pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:39.707044 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.707016 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxpgh\" (UniqueName: \"kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh\") pod \"authorino-7457494f9b-bfm77\" (UID: \"4cb68f0b-85b8-4ced-b248-3731653ace52\") " pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:39.745804 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.745775 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:39.746061 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.746049 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:39.784262 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.784223 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:49:39.787148 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.787128 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:39.791129 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.791106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 01 17:49:39.807359 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.807331 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:49:39.892788 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:39.892756 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cb68f0b_85b8_4ced_b248_3731653ace52.slice/crio-f18d0528081adb497cf54d9bfdafaa31241db7b8c2ece62a359fb836503bdcc9 WatchSource:0}: Error finding container f18d0528081adb497cf54d9bfdafaa31241db7b8c2ece62a359fb836503bdcc9: Status 404 returned error can't find the container with id f18d0528081adb497cf54d9bfdafaa31241db7b8c2ece62a359fb836503bdcc9 Jul 01 17:49:39.893920 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.893898 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:39.896931 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.896908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:39.897047 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.897027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4479z\" (UniqueName: \"kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:39.997903 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.997880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:39.998030 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:39.997982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4479z\" (UniqueName: \"kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:40.000316 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.000292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:40.009294 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.009273 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4479z\" (UniqueName: \"kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z\") pod \"authorino-6c84674d6d-xqxpj\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:40.099285 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.099253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:49:40.245869 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.245846 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:49:40.247751 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:40.247715 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75bcd2f7_7676_4259_b464_63df6c258e6a.slice/crio-f242b9b8b750c738c82123033882daef70b75bd347f76ffaeb323a025ff81315 WatchSource:0}: Error finding container f242b9b8b750c738c82123033882daef70b75bd347f76ffaeb323a025ff81315: Status 404 returned error can't find the container with id f242b9b8b750c738c82123033882daef70b75bd347f76ffaeb323a025ff81315 Jul 01 17:49:40.617456 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.617418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" event={"ID":"75bcd2f7-7676-4259-b464-63df6c258e6a","Type":"ContainerStarted","Data":"f242b9b8b750c738c82123033882daef70b75bd347f76ffaeb323a025ff81315"} Jul 01 17:49:40.619240 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.619219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7457494f9b-bfm77" event={"ID":"4cb68f0b-85b8-4ced-b248-3731653ace52","Type":"ContainerStarted","Data":"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0"} Jul 01 17:49:40.619348 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.619253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7457494f9b-bfm77" event={"ID":"4cb68f0b-85b8-4ced-b248-3731653ace52","Type":"ContainerStarted","Data":"f18d0528081adb497cf54d9bfdafaa31241db7b8c2ece62a359fb836503bdcc9"} Jul 01 17:49:40.619348 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.619267 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7457494f9b-bfm77" podUID="4cb68f0b-85b8-4ced-b248-3731653ace52" containerName="authorino" containerID="cri-o://1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0" gracePeriod=30 Jul 01 17:49:40.620819 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.620798 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-np442" event={"ID":"4b5e8eac-42ff-402b-8253-d0caf2f255f6","Type":"ContainerStarted","Data":"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41"} Jul 01 17:49:40.620948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.620880 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-np442" podUID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" containerName="authorino" containerID="cri-o://2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41" gracePeriod=30 Jul 01 17:49:40.637083 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.637047 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7457494f9b-bfm77" podStartSLOduration=1.272770273 podStartE2EDuration="1.637035087s" totalImagesPullingTime="364.264814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:40.635917644 +0000 UTC m=+640.629186839" watchObservedRunningTime="2026-07-01 17:49:40.637035087 +0000 UTC m=+640.630304279" Jul 01 17:49:40.654848 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.654806 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-np442" podStartSLOduration=1.263431867 podStartE2EDuration="1.654792569s" totalImagesPullingTime="391.360702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:40.653284079 +0000 UTC m=+640.646553269" watchObservedRunningTime="2026-07-01 17:49:40.654792569 +0000 UTC m=+640.648061760" Jul 01 17:49:40.897833 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.897809 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:40.905535 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:40.905513 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:41.006518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.006490 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d99ds\" (UniqueName: \"kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds\") pod \"4b5e8eac-42ff-402b-8253-d0caf2f255f6\" (UID: \"4b5e8eac-42ff-402b-8253-d0caf2f255f6\") " Jul 01 17:49:41.006678 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.006576 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxpgh\" (UniqueName: \"kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh\") pod \"4cb68f0b-85b8-4ced-b248-3731653ace52\" (UID: \"4cb68f0b-85b8-4ced-b248-3731653ace52\") " Jul 01 17:49:41.008607 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.008582 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh" (OuterVolumeSpecName: "kube-api-access-pxpgh") pod "4cb68f0b-85b8-4ced-b248-3731653ace52" (UID: "4cb68f0b-85b8-4ced-b248-3731653ace52"). InnerVolumeSpecName "kube-api-access-pxpgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:49:41.008697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.008640 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds" (OuterVolumeSpecName: "kube-api-access-d99ds") pod "4b5e8eac-42ff-402b-8253-d0caf2f255f6" (UID: "4b5e8eac-42ff-402b-8253-d0caf2f255f6"). InnerVolumeSpecName "kube-api-access-d99ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:49:41.107999 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.107963 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxpgh\" (UniqueName: \"kubernetes.io/projected/4cb68f0b-85b8-4ced-b248-3731653ace52-kube-api-access-pxpgh\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:49:41.107999 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.107997 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d99ds\" (UniqueName: \"kubernetes.io/projected/4b5e8eac-42ff-402b-8253-d0caf2f255f6-kube-api-access-d99ds\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:49:41.633792 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.633760 2582 generic.go:356] "Generic (PLEG): container finished" podID="4cb68f0b-85b8-4ced-b248-3731653ace52" containerID="1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0" exitCode=0 Jul 01 17:49:41.634245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.633811 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7457494f9b-bfm77" Jul 01 17:49:41.634245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.633841 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7457494f9b-bfm77" event={"ID":"4cb68f0b-85b8-4ced-b248-3731653ace52","Type":"ContainerDied","Data":"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0"} Jul 01 17:49:41.634245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.633888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7457494f9b-bfm77" event={"ID":"4cb68f0b-85b8-4ced-b248-3731653ace52","Type":"ContainerDied","Data":"f18d0528081adb497cf54d9bfdafaa31241db7b8c2ece62a359fb836503bdcc9"} Jul 01 17:49:41.634245 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.633910 2582 scope.go:117] "RemoveContainer" containerID="1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0" Jul 01 17:49:41.635279 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.635259 2582 generic.go:356] "Generic (PLEG): container finished" podID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" containerID="2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41" exitCode=0 Jul 01 17:49:41.635363 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.635297 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-np442" Jul 01 17:49:41.635363 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.635344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-np442" event={"ID":"4b5e8eac-42ff-402b-8253-d0caf2f255f6","Type":"ContainerDied","Data":"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41"} Jul 01 17:49:41.635463 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.635376 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-np442" event={"ID":"4b5e8eac-42ff-402b-8253-d0caf2f255f6","Type":"ContainerDied","Data":"f2f117e8371ad43cf29002c4893bf6ffbaf88d3cb546ed85d3797bf44ea8c5b8"} Jul 01 17:49:41.637187 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.637168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" event={"ID":"75bcd2f7-7676-4259-b464-63df6c258e6a","Type":"ContainerStarted","Data":"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792"} Jul 01 17:49:41.642995 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.642979 2582 scope.go:117] "RemoveContainer" containerID="1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0" Jul 01 17:49:41.643251 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:49:41.643228 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0\": container with ID starting with 1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0 not found: ID does not exist" containerID="1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0" Jul 01 17:49:41.643311 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.643263 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0"} err="failed to get container status \"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0\": rpc error: code = NotFound desc = could not find container \"1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0\": container with ID starting with 1aad86b5f781c90f989389e75bee5fc5bced000511b16378fd5f579bacf1f9b0 not found: ID does not exist" Jul 01 17:49:41.643311 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.643286 2582 scope.go:117] "RemoveContainer" containerID="2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41" Jul 01 17:49:41.651345 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.651325 2582 scope.go:117] "RemoveContainer" containerID="2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41" Jul 01 17:49:41.651579 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:49:41.651553 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41\": container with ID starting with 2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41 not found: ID does not exist" containerID="2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41" Jul 01 17:49:41.651620 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.651587 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41"} err="failed to get container status \"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41\": rpc error: code = NotFound desc = could not find container \"2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41\": container with ID starting with 2ef2ca0e5f1e50f51008603c4a1294b4a93c3152661ae1a462cfa6c510991c41 not found: ID does not exist" Jul 01 17:49:41.660589 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.660554 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" podStartSLOduration=2.314560067 podStartE2EDuration="2.660542632s" totalImagesPullingTime="345.982565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:41.658746583 +0000 UTC m=+641.652015775" watchObservedRunningTime="2026-07-01 17:49:41.660542632 +0000 UTC m=+641.653811823" Jul 01 17:49:41.683790 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.683732 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:41.690494 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.690470 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-np442"] Jul 01 17:49:41.694170 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.694147 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:49:41.694346 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.694328 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p6j4r" podUID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" containerName="authorino" containerID="cri-o://21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4" gracePeriod=30 Jul 01 17:49:41.708071 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.708050 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:41.712446 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.712428 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7457494f9b-bfm77"] Jul 01 17:49:41.953423 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:41.953396 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:49:42.015661 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.015629 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7fll\" (UniqueName: \"kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll\") pod \"b0241bf6-3fd3-44c8-b892-1bf560c0504d\" (UID: \"b0241bf6-3fd3-44c8-b892-1bf560c0504d\") " Jul 01 17:49:42.017688 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.017663 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll" (OuterVolumeSpecName: "kube-api-access-q7fll") pod "b0241bf6-3fd3-44c8-b892-1bf560c0504d" (UID: "b0241bf6-3fd3-44c8-b892-1bf560c0504d"). InnerVolumeSpecName "kube-api-access-q7fll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:49:42.117089 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.117065 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7fll\" (UniqueName: \"kubernetes.io/projected/b0241bf6-3fd3-44c8-b892-1bf560c0504d-kube-api-access-q7fll\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:49:42.643463 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.643425 2582 generic.go:356] "Generic (PLEG): container finished" podID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" containerID="21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4" exitCode=0 Jul 01 17:49:42.643890 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.643514 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p6j4r" Jul 01 17:49:42.648005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.647982 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" path="/var/lib/kubelet/pods/4b5e8eac-42ff-402b-8253-d0caf2f255f6/volumes" Jul 01 17:49:42.648323 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.648307 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb68f0b-85b8-4ced-b248-3731653ace52" path="/var/lib/kubelet/pods/4cb68f0b-85b8-4ced-b248-3731653ace52/volumes" Jul 01 17:49:42.648638 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.648623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p6j4r" event={"ID":"b0241bf6-3fd3-44c8-b892-1bf560c0504d","Type":"ContainerDied","Data":"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4"} Jul 01 17:49:42.648679 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.648649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p6j4r" event={"ID":"b0241bf6-3fd3-44c8-b892-1bf560c0504d","Type":"ContainerDied","Data":"63703e2a298794c925bb50c967ec8963543e7fcbdff792cae327683b0657f82d"} Jul 01 17:49:42.648679 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.648670 2582 scope.go:117] "RemoveContainer" containerID="21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4" Jul 01 17:49:42.657344 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.657321 2582 scope.go:117] "RemoveContainer" containerID="21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4" Jul 01 17:49:42.657591 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:49:42.657573 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4\": container with ID starting with 21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4 not found: ID does not exist" containerID="21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4" Jul 01 17:49:42.657655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.657598 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4"} err="failed to get container status \"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4\": rpc error: code = NotFound desc = could not find container \"21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4\": container with ID starting with 21416b2850f5e73743ddd21013c11f129f44a68f2014b81fd34733732e4c3ac4 not found: ID does not exist" Jul 01 17:49:42.807113 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.807080 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:49:42.814384 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:42.814362 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p6j4r"] Jul 01 17:49:44.647509 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:44.647478 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" path="/var/lib/kubelet/pods/b0241bf6-3fd3-44c8-b892-1bf560c0504d/volumes" Jul 01 17:49:46.762920 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.762886 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763256 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763267 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763277 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb68f0b-85b8-4ced-b248-3731653ace52" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763282 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb68f0b-85b8-4ced-b248-3731653ace52" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763297 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763302 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763370 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cb68f0b-85b8-4ced-b248-3731653ace52" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763379 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5e8eac-42ff-402b-8253-d0caf2f255f6" containerName="authorino" Jul 01 17:49:46.763389 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.763386 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0241bf6-3fd3-44c8-b892-1bf560c0504d" containerName="authorino" Jul 01 17:49:46.767885 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.767868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.771313 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.771296 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-knfzb\"" Jul 01 17:49:46.771578 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.771554 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 17:49:46.772252 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.772237 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 17:49:46.781759 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.781735 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:49:46.869244 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.869216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kff\" (UniqueName: \"kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.869414 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.869282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.969951 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.969908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.970095 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.970054 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kff\" (UniqueName: \"kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.970095 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:49:46.970063 2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 17:49:46.970212 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:49:46.970124 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert podName:bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca nodeName:}" failed. No retries permitted until 2026-07-01 17:49:47.470105367 +0000 UTC m=+647.463374539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert") pod "maas-controller-94b6f6cff-k9zfg" (UID: "bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca") : secret "maas-controller-webhook-cert" not found Jul 01 17:49:46.993510 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.993483 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c8fb596c-kj4v2"] Jul 01 17:49:46.996442 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.996419 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kff\" (UniqueName: \"kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:46.997162 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:46.997148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.022539 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.022488 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c8fb596c-kj4v2"] Jul 01 17:49:47.070614 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.070592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99b224a2-caf9-4e2a-b39b-dfbce585418b-webhook-cert\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.070733 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.070671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd9t4\" (UniqueName: \"kubernetes.io/projected/99b224a2-caf9-4e2a-b39b-dfbce585418b-kube-api-access-rd9t4\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.171297 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.171269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99b224a2-caf9-4e2a-b39b-dfbce585418b-webhook-cert\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.171459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.171429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd9t4\" (UniqueName: \"kubernetes.io/projected/99b224a2-caf9-4e2a-b39b-dfbce585418b-kube-api-access-rd9t4\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.173633 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.173610 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99b224a2-caf9-4e2a-b39b-dfbce585418b-webhook-cert\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.182329 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.182309 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd9t4\" (UniqueName: \"kubernetes.io/projected/99b224a2-caf9-4e2a-b39b-dfbce585418b-kube-api-access-rd9t4\") pod \"maas-controller-75c8fb596c-kj4v2\" (UID: \"99b224a2-caf9-4e2a-b39b-dfbce585418b\") " pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.313650 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.313625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:47.472242 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.472219 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c8fb596c-kj4v2"] Jul 01 17:49:47.473167 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:47.473143 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b224a2_caf9_4e2a_b39b_dfbce585418b.slice/crio-08fdb5a083568edc452828e9e0ba2c5b44c43ee97042501c7d1f6f1e1a3247ba WatchSource:0}: Error finding container 08fdb5a083568edc452828e9e0ba2c5b44c43ee97042501c7d1f6f1e1a3247ba: Status 404 returned error can't find the container with id 08fdb5a083568edc452828e9e0ba2c5b44c43ee97042501c7d1f6f1e1a3247ba Jul 01 17:49:47.474303 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.474279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:47.476565 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.476543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") pod \"maas-controller-94b6f6cff-k9zfg\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:47.671429 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.671342 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" event={"ID":"99b224a2-caf9-4e2a-b39b-dfbce585418b","Type":"ContainerStarted","Data":"08fdb5a083568edc452828e9e0ba2c5b44c43ee97042501c7d1f6f1e1a3247ba"} Jul 01 17:49:47.680690 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.680676 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:47.834071 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:47.834042 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:49:47.837317 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:49:47.837292 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab13b1d_f5e5_4ff9_84b0_fa34aa11b6ca.slice/crio-e5352b121631b79c8a21dbca309f3129d81a261b81ae7495cc5b79c4db3bf041 WatchSource:0}: Error finding container e5352b121631b79c8a21dbca309f3129d81a261b81ae7495cc5b79c4db3bf041: Status 404 returned error can't find the container with id e5352b121631b79c8a21dbca309f3129d81a261b81ae7495cc5b79c4db3bf041 Jul 01 17:49:48.679420 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:48.679383 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" event={"ID":"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca","Type":"ContainerStarted","Data":"e5352b121631b79c8a21dbca309f3129d81a261b81ae7495cc5b79c4db3bf041"} Jul 01 17:49:50.692526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.692492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" event={"ID":"99b224a2-caf9-4e2a-b39b-dfbce585418b","Type":"ContainerStarted","Data":"023772abbf8fe6738ce310ccd3de8382748adf80c2c14689ab915a0468eea80b"} Jul 01 17:49:50.693042 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.692595 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:49:50.694187 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.694162 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" event={"ID":"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca","Type":"ContainerStarted","Data":"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09"} Jul 01 17:49:50.694327 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.694206 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:49:50.796289 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.796242 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" podStartSLOduration=2.455509774 podStartE2EDuration="4.796226953s" totalImagesPullingTime="2.340717179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:50.794607482 +0000 UTC m=+650.787876674" watchObservedRunningTime="2026-07-01 17:49:50.796226953 +0000 UTC m=+650.789496145" Jul 01 17:49:50.796855 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:49:50.796833 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" podStartSLOduration=2.102564143 podStartE2EDuration="4.796824823s" totalImagesPullingTime="2.69426068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:49:50.74150273 +0000 UTC m=+650.734771921" watchObservedRunningTime="2026-07-01 17:49:50.796824823 +0000 UTC m=+650.790094029" Jul 01 17:50:01.708188 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:01.708158 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" Jul 01 17:50:01.708663 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:01.708237 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:50:01.863807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:01.863774 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:50:01.864043 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:01.863993 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" podUID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" containerName="manager" containerID="cri-o://14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09" gracePeriod=30 Jul 01 17:50:02.120728 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.120701 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:50:02.212854 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.212804 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") pod \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " Jul 01 17:50:02.213104 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.212899 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92kff\" (UniqueName: \"kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff\") pod \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\" (UID: \"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca\") " Jul 01 17:50:02.215205 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.215174 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" (UID: "bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:50:02.215328 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.215246 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff" (OuterVolumeSpecName: "kube-api-access-92kff") pod "bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" (UID: "bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca"). InnerVolumeSpecName "kube-api-access-92kff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:50:02.313812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.313779 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92kff\" (UniqueName: \"kubernetes.io/projected/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-kube-api-access-92kff\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:50:02.313812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.313814 2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca-webhook-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:50:02.751622 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.751585 2582 generic.go:356] "Generic (PLEG): container finished" podID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" containerID="14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09" exitCode=0 Jul 01 17:50:02.752045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.751647 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" Jul 01 17:50:02.752045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.751678 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" event={"ID":"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca","Type":"ContainerDied","Data":"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09"} Jul 01 17:50:02.752045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.751735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-94b6f6cff-k9zfg" event={"ID":"bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca","Type":"ContainerDied","Data":"e5352b121631b79c8a21dbca309f3129d81a261b81ae7495cc5b79c4db3bf041"} Jul 01 17:50:02.752045 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.751759 2582 scope.go:117] "RemoveContainer" containerID="14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09" Jul 01 17:50:02.760309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.760285 2582 scope.go:117] "RemoveContainer" containerID="14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09" Jul 01 17:50:02.760545 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:50:02.760527 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09\": container with ID starting with 14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09 not found: ID does not exist" containerID="14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09" Jul 01 17:50:02.760624 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.760552 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09"} err="failed to get container status \"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09\": rpc error: code = NotFound desc = could not find container \"14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09\": container with ID starting with 14f73dec640f38e2b2830818c8360e27bb34470831377c2c2995eeccd0118e09 not found: ID does not exist" Jul 01 17:50:02.772099 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.772081 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:50:02.777172 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:02.777152 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-94b6f6cff-k9zfg"] Jul 01 17:50:04.647397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:04.647361 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" path="/var/lib/kubelet/pods/bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca/volumes" Jul 01 17:50:22.506581 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.506546 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-668ddc48fb-mjdbn"] Jul 01 17:50:22.507193 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.507137 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" containerName="manager" Jul 01 17:50:22.507193 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.507157 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" containerName="manager" Jul 01 17:50:22.507326 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.507296 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bab13b1d-f5e5-4ff9-84b0-fa34aa11b6ca" containerName="manager" Jul 01 17:50:22.513019 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.512999 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.521214 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.521195 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 17:50:22.521918 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.521899 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6hnpv\"" Jul 01 17:50:22.540495 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.540471 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-668ddc48fb-mjdbn"] Jul 01 17:50:22.608294 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.608258 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-openshift-service-ca\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.608465 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.608314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-maas-api-tls\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.608465 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.608336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrcbg\" (UniqueName: \"kubernetes.io/projected/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-kube-api-access-mrcbg\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.708995 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.708960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-openshift-service-ca\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.709196 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.709047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-maas-api-tls\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.709196 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.709081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrcbg\" (UniqueName: \"kubernetes.io/projected/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-kube-api-access-mrcbg\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.709741 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.709719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-openshift-service-ca\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.711436 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.711417 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-maas-api-tls\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.729063 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.729036 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrcbg\" (UniqueName: \"kubernetes.io/projected/ec294772-2bdc-4bba-92e9-2eb50e8e50e5-kube-api-access-mrcbg\") pod \"maas-api-668ddc48fb-mjdbn\" (UID: \"ec294772-2bdc-4bba-92e9-2eb50e8e50e5\") " pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.823133 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.823107 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:22.986596 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:50:22.986565 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec294772_2bdc_4bba_92e9_2eb50e8e50e5.slice/crio-f4bf53f55f6fa5a42ce3e36d4d6aeb05e3e54bfa17d0b5c52f6032868340b2e2 WatchSource:0}: Error finding container f4bf53f55f6fa5a42ce3e36d4d6aeb05e3e54bfa17d0b5c52f6032868340b2e2: Status 404 returned error can't find the container with id f4bf53f55f6fa5a42ce3e36d4d6aeb05e3e54bfa17d0b5c52f6032868340b2e2 Jul 01 17:50:22.990259 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:22.990237 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-668ddc48fb-mjdbn"] Jul 01 17:50:23.755365 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.755327 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mrwqc"] Jul 01 17:50:23.760127 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.760104 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.764362 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.764336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 01 17:50:23.779523 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.779502 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mrwqc"] Jul 01 17:50:23.820221 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.820197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gglnm\" (UniqueName: \"kubernetes.io/projected/34895c85-bfab-47ac-8a13-7993b45d924e-kube-api-access-gglnm\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.820337 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.820237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34895c85-bfab-47ac-8a13-7993b45d924e-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.854697 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.854671 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-668ddc48fb-mjdbn" event={"ID":"ec294772-2bdc-4bba-92e9-2eb50e8e50e5","Type":"ContainerStarted","Data":"f4bf53f55f6fa5a42ce3e36d4d6aeb05e3e54bfa17d0b5c52f6032868340b2e2"} Jul 01 17:50:23.889052 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.889030 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s"] Jul 01 17:50:23.892737 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.892717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:23.897669 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.897647 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qxx5c\"" Jul 01 17:50:23.921021 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.920998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gglnm\" (UniqueName: \"kubernetes.io/projected/34895c85-bfab-47ac-8a13-7993b45d924e-kube-api-access-gglnm\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.921171 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.921087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34895c85-bfab-47ac-8a13-7993b45d924e-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.921778 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.921755 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34895c85-bfab-47ac-8a13-7993b45d924e-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:23.937557 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.937536 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s"] Jul 01 17:50:23.945906 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:23.945879 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gglnm\" (UniqueName: \"kubernetes.io/projected/34895c85-bfab-47ac-8a13-7993b45d924e-kube-api-access-gglnm\") pod \"payload-processing-7bbcb654f4-mrwqc\" (UID: \"34895c85-bfab-47ac-8a13-7993b45d924e\") " pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:24.022299 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.022217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d3292a7-9bf3-455a-a1bb-e057de2b2440-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.022299 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.022255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tm5r\" (UniqueName: \"kubernetes.io/projected/0d3292a7-9bf3-455a-a1bb-e057de2b2440-kube-api-access-2tm5r\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.071298 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.071263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:24.123601 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.123547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d3292a7-9bf3-455a-a1bb-e057de2b2440-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.123797 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.123616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tm5r\" (UniqueName: \"kubernetes.io/projected/0d3292a7-9bf3-455a-a1bb-e057de2b2440-kube-api-access-2tm5r\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.124807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.124777 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d3292a7-9bf3-455a-a1bb-e057de2b2440-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.138995 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.138970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tm5r\" (UniqueName: \"kubernetes.io/projected/0d3292a7-9bf3-455a-a1bb-e057de2b2440-kube-api-access-2tm5r\") pod \"payload-pre-processing-59f49fd4f6-lxl7s\" (UID: \"0d3292a7-9bf3-455a-a1bb-e057de2b2440\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.203476 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.203443 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:24.233777 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.233744 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-mrwqc"] Jul 01 17:50:24.235052 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:50:24.235014 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34895c85_bfab_47ac_8a13_7993b45d924e.slice/crio-fc2d2ae1a027aae92a62f5275d509e7e1f969c7d1c8d9de9d4b77e18fb2c012b WatchSource:0}: Error finding container fc2d2ae1a027aae92a62f5275d509e7e1f969c7d1c8d9de9d4b77e18fb2c012b: Status 404 returned error can't find the container with id fc2d2ae1a027aae92a62f5275d509e7e1f969c7d1c8d9de9d4b77e18fb2c012b Jul 01 17:50:24.358397 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.358373 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s"] Jul 01 17:50:24.359210 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:50:24.359191 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3292a7_9bf3_455a_a1bb_e057de2b2440.slice/crio-a954934f387c6cfd11279f449ebed6088b997622ddfd661d11dbe7e19447b0d0 WatchSource:0}: Error finding container a954934f387c6cfd11279f449ebed6088b997622ddfd661d11dbe7e19447b0d0: Status 404 returned error can't find the container with id a954934f387c6cfd11279f449ebed6088b997622ddfd661d11dbe7e19447b0d0 Jul 01 17:50:24.862593 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.862543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerStarted","Data":"fc2d2ae1a027aae92a62f5275d509e7e1f969c7d1c8d9de9d4b77e18fb2c012b"} Jul 01 17:50:24.863869 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:24.863846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" event={"ID":"0d3292a7-9bf3-455a-a1bb-e057de2b2440","Type":"ContainerStarted","Data":"a954934f387c6cfd11279f449ebed6088b997622ddfd661d11dbe7e19447b0d0"} Jul 01 17:50:28.894360 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.894323 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-668ddc48fb-mjdbn" event={"ID":"ec294772-2bdc-4bba-92e9-2eb50e8e50e5","Type":"ContainerStarted","Data":"30affbabff5f0f2ab4d1f50cd997fdf284aec60cde3706598d0e93535f52f7e7"} Jul 01 17:50:28.894831 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.894391 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:28.895919 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.895896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" event={"ID":"0d3292a7-9bf3-455a-a1bb-e057de2b2440","Type":"ContainerStarted","Data":"f02bfe6627134f84e2cb88fd83a49046c86b6026906da7ce5cc999d57911799d"} Jul 01 17:50:28.896057 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.895997 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:28.897416 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.897389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerStarted","Data":"5755e407aec238ee5a1942c3cc2aa93f5f22690bacb7a097f81c8873155ca70b"} Jul 01 17:50:28.897526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.897511 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:28.922123 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.922084 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-668ddc48fb-mjdbn" podStartSLOduration=1.8834747429999998 podStartE2EDuration="6.922072008s" totalImagesPullingTime="5.038597265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:50:28.920229753 +0000 UTC m=+688.913498944" watchObservedRunningTime="2026-07-01 17:50:28.922072008 +0000 UTC m=+688.915341199" Jul 01 17:50:28.942513 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.942446 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" podStartSLOduration=2.275543545 podStartE2EDuration="5.942427133s" totalImagesPullingTime="3.666883588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:50:28.941675692 +0000 UTC m=+688.934944885" watchObservedRunningTime="2026-07-01 17:50:28.942427133 +0000 UTC m=+688.935696327" Jul 01 17:50:28.970518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:28.970466 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" podStartSLOduration=2.174816281 podStartE2EDuration="5.970452219s" totalImagesPullingTime="3.795635938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:50:28.969195644 +0000 UTC m=+688.962464835" watchObservedRunningTime="2026-07-01 17:50:28.970452219 +0000 UTC m=+688.963721461" Jul 01 17:50:32.919319 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.919287 2582 generic.go:356] "Generic (PLEG): container finished" podID="1433dabf-dc03-4668-b518-52db3caf7d7d" containerID="46cf029d72c2d1ad7324a6e63858a2521a3575a874b79159158b3a80b7e394f9" exitCode=0 Jul 01 17:50:32.919751 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.919359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" event={"ID":"1433dabf-dc03-4668-b518-52db3caf7d7d","Type":"ContainerDied","Data":"46cf029d72c2d1ad7324a6e63858a2521a3575a874b79159158b3a80b7e394f9"} Jul 01 17:50:32.919751 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.919746 2582 scope.go:117] "RemoveContainer" containerID="46cf029d72c2d1ad7324a6e63858a2521a3575a874b79159158b3a80b7e394f9" Jul 01 17:50:32.920729 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.920701 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:50:32.920801 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.920785 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:50:32.920850 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:32.920834 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 01 17:50:33.929156 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:33.929122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" event={"ID":"1433dabf-dc03-4668-b518-52db3caf7d7d","Type":"ContainerStarted","Data":"e8f442b8757830859c1fca7d86d49ee2612df04348a0965973d96c365fbf0130"} Jul 01 17:50:34.817282 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:34.817246 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:50:34.818520 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:34.818495 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-qjxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 01 17:50:34.818653 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:34.818541 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" podUID="1433dabf-dc03-4668-b518-52db3caf7d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 01 17:50:34.909916 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:34.909890 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-668ddc48fb-mjdbn" Jul 01 17:50:35.817953 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:35.817896 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-qjxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 01 17:50:35.818352 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:35.818009 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" podUID="1433dabf-dc03-4668-b518-52db3caf7d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 01 17:50:36.446057 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:36.446022 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:36.446622 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:36.446588 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" containerID="cri-o://769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90" gracePeriod=30 Jul 01 17:50:36.817866 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:36.817835 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-qjxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 01 17:50:36.818083 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:36.817893 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" podUID="1433dabf-dc03-4668-b518-52db3caf7d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 01 17:50:37.817450 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:37.817418 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-qjxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 01 17:50:37.817626 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:37.817471 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" podUID="1433dabf-dc03-4668-b518-52db3caf7d7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 01 17:50:38.092691 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.092667 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:50:38.111415 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.111391 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:38.193388 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.193361 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs8hk\" (UniqueName: \"kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk\") pod \"211e49e5-90ca-4a4c-a583-946672b06bde\" (UID: \"211e49e5-90ca-4a4c-a583-946672b06bde\") " Jul 01 17:50:38.195464 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.195439 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk" (OuterVolumeSpecName: "kube-api-access-zs8hk") pod "211e49e5-90ca-4a4c-a583-946672b06bde" (UID: "211e49e5-90ca-4a4c-a583-946672b06bde"). InnerVolumeSpecName "kube-api-access-zs8hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:50:38.294805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.294769 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs8hk\" (UniqueName: \"kubernetes.io/projected/211e49e5-90ca-4a4c-a583-946672b06bde-kube-api-access-zs8hk\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:50:38.821859 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.821829 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:50:38.966533 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.966429 2582 generic.go:356] "Generic (PLEG): container finished" podID="211e49e5-90ca-4a4c-a583-946672b06bde" containerID="769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90" exitCode=143 Jul 01 17:50:38.966533 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.966467 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:38.966533 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.966522 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"211e49e5-90ca-4a4c-a583-946672b06bde","Type":"ContainerDied","Data":"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90"} Jul 01 17:50:38.966899 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.966568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"211e49e5-90ca-4a4c-a583-946672b06bde","Type":"ContainerDied","Data":"4e046da071b7d7f6d3059cde6a830459d575ac87bbfdf1e82277525a2c091087"} Jul 01 17:50:38.966899 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.966594 2582 scope.go:117] "RemoveContainer" containerID="769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90" Jul 01 17:50:38.968076 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.968055 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-qjxdx" Jul 01 17:50:38.976864 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.976844 2582 scope.go:117] "RemoveContainer" containerID="769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90" Jul 01 17:50:38.977195 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:50:38.977171 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90\": container with ID starting with 769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90 not found: ID does not exist" containerID="769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90" Jul 01 17:50:38.977266 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:38.977203 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90"} err="failed to get container status \"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90\": rpc error: code = NotFound desc = could not find container \"769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90\": container with ID starting with 769f0a1192384ded3b3fd37a7dda82cb8fded82c45008b32ff5743a16db86b90 not found: ID does not exist" Jul 01 17:50:39.026974 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.026919 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:39.034523 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.034496 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:39.083847 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.083821 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:39.084230 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.084217 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" Jul 01 17:50:39.084278 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.084231 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" Jul 01 17:50:39.084314 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.084298 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" containerName="keycloak" Jul 01 17:50:39.088404 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.088389 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.100506 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.100488 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 17:50:39.100809 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.100744 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 17:50:39.101420 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.101408 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 17:50:39.101616 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.101599 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 17:50:39.104644 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.104630 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dl4lt\"" Jul 01 17:50:39.167665 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.167641 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:39.203010 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.202981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftdj\" (UniqueName: \"kubernetes.io/projected/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-kube-api-access-9ftdj\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.203116 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.203017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-test-realms\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.304179 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.304152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftdj\" (UniqueName: \"kubernetes.io/projected/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-kube-api-access-9ftdj\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.304312 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.304185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-test-realms\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.304819 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.304802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-test-realms\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.320918 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.320899 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftdj\" (UniqueName: \"kubernetes.io/projected/e9a8bdd6-4368-44eb-ae79-9a19a89bfac8-kube-api-access-9ftdj\") pod \"maas-keycloak-0\" (UID: \"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8\") " pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.397566 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.397541 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:39.553133 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.553112 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 17:50:39.555152 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:50:39.555083 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a8bdd6_4368_44eb_ae79_9a19a89bfac8.slice/crio-f85f28d8b6b42de4d9b6424d0219b2cb091694f3c1e4899e5d5e37607b4a85d8 WatchSource:0}: Error finding container f85f28d8b6b42de4d9b6424d0219b2cb091694f3c1e4899e5d5e37607b4a85d8: Status 404 returned error can't find the container with id f85f28d8b6b42de4d9b6424d0219b2cb091694f3c1e4899e5d5e37607b4a85d8 Jul 01 17:50:39.906566 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.906469 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" podUID="0d3292a7-9bf3-455a-a1bb-e057de2b2440" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.48:9004: connect: connection refused" Jul 01 17:50:39.906913 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.906895 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:50:39.973860 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:39.973823 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8","Type":"ContainerStarted","Data":"f85f28d8b6b42de4d9b6424d0219b2cb091694f3c1e4899e5d5e37607b4a85d8"} Jul 01 17:50:40.648292 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:40.648261 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="211e49e5-90ca-4a4c-a583-946672b06bde" path="/var/lib/kubelet/pods/211e49e5-90ca-4a4c-a583-946672b06bde/volumes" Jul 01 17:50:41.987060 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:41.987016 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e9a8bdd6-4368-44eb-ae79-9a19a89bfac8","Type":"ContainerStarted","Data":"a2d3e65d3764f213f5283b3dcf197ce8370c5ec1a4c1ca5a8a55aedb6e1954be"} Jul 01 17:50:42.026956 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:42.026875 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.038965023 podStartE2EDuration="3.026854825s" totalImagesPullingTime="1.987889802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:50:42.024429815 +0000 UTC m=+702.017699008" watchObservedRunningTime="2026-07-01 17:50:42.026854825 +0000 UTC m=+702.020124019" Jul 01 17:50:42.397925 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:42.397891 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:42.399896 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:42.399861 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:43.398407 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:43.398360 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:44.398926 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:44.398875 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:45.398831 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:45.398775 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:46.398111 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:46.398076 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:47.398898 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:47.398849 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:48.398242 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:48.398203 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:49.398144 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:49.398107 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:49.398783 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:49.398462 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:49.905313 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:49.905288 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-lxl7s" Jul 01 17:50:50.398446 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:50.398402 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:51.398412 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:51.398372 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:52.398527 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:52.398421 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:52.701403 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:52.701291 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" podUID="99b224a2-caf9-4e2a-b39b-dfbce585418b" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.45:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 01 17:50:53.398467 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:53.398417 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:54.398263 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:54.398216 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.49:9000/health/started\": dial tcp 10.133.0.49:9000: connect: connection refused" Jul 01 17:50:55.503761 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:55.503725 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 17:50:55.521382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:50:55.521320 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e9a8bdd6-4368-44eb-ae79-9a19a89bfac8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:51:05.510800 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:05.510768 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 17:51:16.270955 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.270903 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:51:16.278361 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.278341 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.282070 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.282053 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 01 17:51:16.291034 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.291011 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:51:16.399446 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.399415 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6zsf\" (UniqueName: \"kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.399645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.399452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.399645 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.399599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.500269 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.500238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.500454 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.500289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6zsf\" (UniqueName: \"kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.500454 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.500312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.500975 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.500957 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.502652 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.502628 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.509778 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.509750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6zsf\" (UniqueName: \"kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf\") pod \"authorino-7bff4df978-8l7b6\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.587155 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.587133 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:51:16.718761 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:16.718741 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:51:16.719730 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:51:16.719701 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f0c2b12_6f18_4ab1_b29b_f95adb753051.slice/crio-0ed91315b671bf2bb10024f2fac9f452874256fad5ad1511a8ae9164cec83665 WatchSource:0}: Error finding container 0ed91315b671bf2bb10024f2fac9f452874256fad5ad1511a8ae9164cec83665: Status 404 returned error can't find the container with id 0ed91315b671bf2bb10024f2fac9f452874256fad5ad1511a8ae9164cec83665 Jul 01 17:51:17.214404 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:17.214366 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bff4df978-8l7b6" event={"ID":"3f0c2b12-6f18-4ab1-b29b-f95adb753051","Type":"ContainerStarted","Data":"0ed91315b671bf2bb10024f2fac9f452874256fad5ad1511a8ae9164cec83665"} Jul 01 17:51:18.222241 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.222145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bff4df978-8l7b6" event={"ID":"3f0c2b12-6f18-4ab1-b29b-f95adb753051","Type":"ContainerStarted","Data":"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969"} Jul 01 17:51:18.242655 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.242604 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bff4df978-8l7b6" podStartSLOduration=1.05147383 podStartE2EDuration="2.242589394s" totalImagesPullingTime="1.191115564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:51:18.240044355 +0000 UTC m=+738.233313548" watchObservedRunningTime="2026-07-01 17:51:18.242589394 +0000 UTC m=+738.235858585" Jul 01 17:51:18.276326 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.276294 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:51:18.276524 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.276496 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" podUID="75bcd2f7-7676-4259-b464-63df6c258e6a" containerName="authorino" containerID="cri-o://0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792" gracePeriod=30 Jul 01 17:51:18.526443 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.526422 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:51:18.619822 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.619789 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert\") pod \"75bcd2f7-7676-4259-b464-63df6c258e6a\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " Jul 01 17:51:18.619995 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.619879 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4479z\" (UniqueName: \"kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z\") pod \"75bcd2f7-7676-4259-b464-63df6c258e6a\" (UID: \"75bcd2f7-7676-4259-b464-63df6c258e6a\") " Jul 01 17:51:18.621812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.621786 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z" (OuterVolumeSpecName: "kube-api-access-4479z") pod "75bcd2f7-7676-4259-b464-63df6c258e6a" (UID: "75bcd2f7-7676-4259-b464-63df6c258e6a"). InnerVolumeSpecName "kube-api-access-4479z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:51:18.630482 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.630460 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "75bcd2f7-7676-4259-b464-63df6c258e6a" (UID: "75bcd2f7-7676-4259-b464-63df6c258e6a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:51:18.721003 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.720979 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75bcd2f7-7676-4259-b464-63df6c258e6a-tls-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:51:18.721003 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:18.721003 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4479z\" (UniqueName: \"kubernetes.io/projected/75bcd2f7-7676-4259-b464-63df6c258e6a-kube-api-access-4479z\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:51:19.228814 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.228723 2582 generic.go:356] "Generic (PLEG): container finished" podID="75bcd2f7-7676-4259-b464-63df6c258e6a" containerID="0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792" exitCode=0 Jul 01 17:51:19.228814 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.228770 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" Jul 01 17:51:19.228814 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.228781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" event={"ID":"75bcd2f7-7676-4259-b464-63df6c258e6a","Type":"ContainerDied","Data":"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792"} Jul 01 17:51:19.229390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.228823 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c84674d6d-xqxpj" event={"ID":"75bcd2f7-7676-4259-b464-63df6c258e6a","Type":"ContainerDied","Data":"f242b9b8b750c738c82123033882daef70b75bd347f76ffaeb323a025ff81315"} Jul 01 17:51:19.229390 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.228840 2582 scope.go:117] "RemoveContainer" containerID="0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792" Jul 01 17:51:19.237487 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.237471 2582 scope.go:117] "RemoveContainer" containerID="0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792" Jul 01 17:51:19.237744 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:51:19.237725 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792\": container with ID starting with 0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792 not found: ID does not exist" containerID="0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792" Jul 01 17:51:19.237803 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.237757 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792"} err="failed to get container status \"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792\": rpc error: code = NotFound desc = could not find container \"0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792\": container with ID starting with 0a2e91ffc10caff5177631a65385e9651412fd093c128ec479a00589d4db3792 not found: ID does not exist" Jul 01 17:51:19.265795 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.265773 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:51:19.274965 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:19.274945 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c84674d6d-xqxpj"] Jul 01 17:51:20.648362 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:20.648334 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75bcd2f7-7676-4259-b464-63df6c258e6a" path="/var/lib/kubelet/pods/75bcd2f7-7676-4259-b464-63df6c258e6a/volumes" Jul 01 17:51:42.032382 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.032346 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl"] Jul 01 17:51:42.032780 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.032753 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75bcd2f7-7676-4259-b464-63df6c258e6a" containerName="authorino" Jul 01 17:51:42.032780 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.032763 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="75bcd2f7-7676-4259-b464-63df6c258e6a" containerName="authorino" Jul 01 17:51:42.032853 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.032832 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="75bcd2f7-7676-4259-b464-63df6c258e6a" containerName="authorino" Jul 01 17:51:42.036016 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.035999 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.039168 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.039146 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8w6gd\"" Jul 01 17:51:42.039370 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.039358 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 17:51:42.040409 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.040387 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 17:51:42.040517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.040393 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 17:51:42.051236 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.051216 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl"] Jul 01 17:51:42.142157 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.142129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d60a900-fbbe-4e4b-9b91-688d6befcb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.142157 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.142160 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2sq\" (UniqueName: \"kubernetes.io/projected/0d60a900-fbbe-4e4b-9b91-688d6befcb44-kube-api-access-pg2sq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.142346 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.142239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.142346 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.142320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.142422 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.142364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.243600 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.243566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.243768 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.243638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.243768 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.243695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d60a900-fbbe-4e4b-9b91-688d6befcb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.243768 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.243718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2sq\" (UniqueName: \"kubernetes.io/projected/0d60a900-fbbe-4e4b-9b91-688d6befcb44-kube-api-access-pg2sq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.244005 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.243793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.244075 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.244045 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.244151 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.244122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.245929 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.245906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d60a900-fbbe-4e4b-9b91-688d6befcb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.246235 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.246214 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d60a900-fbbe-4e4b-9b91-688d6befcb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.253454 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.253429 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2sq\" (UniqueName: \"kubernetes.io/projected/0d60a900-fbbe-4e4b-9b91-688d6befcb44-kube-api-access-pg2sq\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl\" (UID: \"0d60a900-fbbe-4e4b-9b91-688d6befcb44\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.345818 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.345787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:42.480664 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:42.480637 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl"] Jul 01 17:51:42.482045 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:51:42.482022 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d60a900_fbbe_4e4b_9b91_688d6befcb44.slice/crio-9c65ddcf61407a465612c2451211cec194d41fe364b84c82497d12e2247c22fd WatchSource:0}: Error finding container 9c65ddcf61407a465612c2451211cec194d41fe364b84c82497d12e2247c22fd: Status 404 returned error can't find the container with id 9c65ddcf61407a465612c2451211cec194d41fe364b84c82497d12e2247c22fd Jul 01 17:51:43.353633 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:43.353597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" event={"ID":"0d60a900-fbbe-4e4b-9b91-688d6befcb44","Type":"ContainerStarted","Data":"9c65ddcf61407a465612c2451211cec194d41fe364b84c82497d12e2247c22fd"} Jul 01 17:51:44.360583 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:44.360549 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" event={"ID":"0d60a900-fbbe-4e4b-9b91-688d6befcb44","Type":"ContainerStarted","Data":"6b9fc4d6b3572da73a631d8101c7b0e8ab163654cf9d4c9ca98fdb7f8faae438"} Jul 01 17:51:44.384072 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:44.384026 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" podStartSLOduration=1.272456105 podStartE2EDuration="2.384010311s" totalImagesPullingTime="1.111554206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:51:44.381294718 +0000 UTC m=+764.374563910" watchObservedRunningTime="2026-07-01 17:51:44.384010311 +0000 UTC m=+764.377279504" Jul 01 17:51:52.346500 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.346465 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:52.346910 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.346553 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:52.359133 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.359106 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:52.400526 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.400502 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg"] Jul 01 17:51:52.404350 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.404329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.415063 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.415047 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 17:51:52.416781 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.416766 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl" Jul 01 17:51:52.422399 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.422377 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg"] Jul 01 17:51:52.442445 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.442422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.442560 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.442454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.442626 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.442591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.442726 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.442700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpghj\" (UniqueName: \"kubernetes.io/projected/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-kube-api-access-rpghj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.442809 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.442794 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543333 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543303 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543333 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpghj\" (UniqueName: \"kubernetes.io/projected/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-kube-api-access-rpghj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543519 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543519 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543519 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543857 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543828 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.543994 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.543859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.545673 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.545644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.546025 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.546007 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.577514 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.577488 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpghj\" (UniqueName: \"kubernetes.io/projected/f16e7206-82c2-43ac-9b0a-7f75cfb248e5-kube-api-access-rpghj\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg\" (UID: \"f16e7206-82c2-43ac-9b0a-7f75cfb248e5\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.714873 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.714794 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:51:52.867827 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:52.867801 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg"] Jul 01 17:51:52.867995 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:51:52.867831 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16e7206_82c2_43ac_9b0a_7f75cfb248e5.slice/crio-bb4c9d495c125d6430ca39e66c8dd5a822020894c263077c9e3c791815add50c WatchSource:0}: Error finding container bb4c9d495c125d6430ca39e66c8dd5a822020894c263077c9e3c791815add50c: Status 404 returned error can't find the container with id bb4c9d495c125d6430ca39e66c8dd5a822020894c263077c9e3c791815add50c Jul 01 17:51:53.411502 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:53.411462 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" event={"ID":"f16e7206-82c2-43ac-9b0a-7f75cfb248e5","Type":"ContainerStarted","Data":"fbf0872a2f9f7d5938521ad017e99df69e6495aad5db991e73261c08557d900c"} Jul 01 17:51:53.412001 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:53.411533 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" event={"ID":"f16e7206-82c2-43ac-9b0a-7f75cfb248e5","Type":"ContainerStarted","Data":"bb4c9d495c125d6430ca39e66c8dd5a822020894c263077c9e3c791815add50c"} Jul 01 17:51:53.439214 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:51:53.439168 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" podStartSLOduration=1.263316286 podStartE2EDuration="1.439154587s" totalImagesPullingTime="175.838301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:51:53.437412066 +0000 UTC m=+773.430681259" watchObservedRunningTime="2026-07-01 17:51:53.439154587 +0000 UTC m=+773.432423778" Jul 01 17:52:02.714992 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:52:02.714950 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:52:02.715502 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:52:02.715035 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:52:02.727498 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:52:02.727477 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:52:03.474478 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:52:03.474449 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg" Jul 01 17:52:32.700812 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:52:32.700728 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-75c8fb596c-kj4v2" podUID="99b224a2-caf9-4e2a-b39b-dfbce585418b" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.45:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 01 17:53:46.090628 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.090593 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69949bdb55-89zhj"] Jul 01 17:53:46.093120 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.093102 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.106290 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.106265 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69949bdb55-89zhj"] Jul 01 17:53:46.109352 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.109325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b41be-2197-4f9e-97b9-7441e4887a11-oidc-ca\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.109523 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.109400 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rq2x\" (UniqueName: \"kubernetes.io/projected/bf9b41be-2197-4f9e-97b9-7441e4887a11-kube-api-access-5rq2x\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.109523 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.109426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf9b41be-2197-4f9e-97b9-7441e4887a11-tls-cert\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.210164 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.210127 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b41be-2197-4f9e-97b9-7441e4887a11-oidc-ca\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.210309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.210193 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rq2x\" (UniqueName: \"kubernetes.io/projected/bf9b41be-2197-4f9e-97b9-7441e4887a11-kube-api-access-5rq2x\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.210309 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.210216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf9b41be-2197-4f9e-97b9-7441e4887a11-tls-cert\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.210891 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.210872 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b41be-2197-4f9e-97b9-7441e4887a11-oidc-ca\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.212580 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.212561 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf9b41be-2197-4f9e-97b9-7441e4887a11-tls-cert\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.219517 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.219496 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rq2x\" (UniqueName: \"kubernetes.io/projected/bf9b41be-2197-4f9e-97b9-7441e4887a11-kube-api-access-5rq2x\") pod \"authorino-69949bdb55-89zhj\" (UID: \"bf9b41be-2197-4f9e-97b9-7441e4887a11\") " pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.428989 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.428888 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69949bdb55-89zhj" Jul 01 17:53:46.569064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.569033 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69949bdb55-89zhj"] Jul 01 17:53:46.570703 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:53:46.570676 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf9b41be_2197_4f9e_97b9_7441e4887a11.slice/crio-7559d57d5c6c8fef82ed9ad2c5fabc643ef1eb5d4d9ab02548568a84ed6f24aa WatchSource:0}: Error finding container 7559d57d5c6c8fef82ed9ad2c5fabc643ef1eb5d4d9ab02548568a84ed6f24aa: Status 404 returned error can't find the container with id 7559d57d5c6c8fef82ed9ad2c5fabc643ef1eb5d4d9ab02548568a84ed6f24aa Jul 01 17:53:46.986085 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:46.986046 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69949bdb55-89zhj" event={"ID":"bf9b41be-2197-4f9e-97b9-7441e4887a11","Type":"ContainerStarted","Data":"7559d57d5c6c8fef82ed9ad2c5fabc643ef1eb5d4d9ab02548568a84ed6f24aa"} Jul 01 17:53:47.992546 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:47.992464 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69949bdb55-89zhj" event={"ID":"bf9b41be-2197-4f9e-97b9-7441e4887a11","Type":"ContainerStarted","Data":"96193910092e6c976b65ba40bcf96575733e012926d3766d486514cc5f6bb59e"} Jul 01 17:53:48.033228 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.033171 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69949bdb55-89zhj" podStartSLOduration=1.015109794 podStartE2EDuration="2.033149242s" totalImagesPullingTime="1.018039448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:53:48.029486118 +0000 UTC m=+888.022755313" watchObservedRunningTime="2026-07-01 17:53:48.033149242 +0000 UTC m=+888.026418435" Jul 01 17:53:48.094757 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.094720 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:53:48.094988 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.094957 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bff4df978-8l7b6" podUID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" containerName="authorino" containerID="cri-o://c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969" gracePeriod=30 Jul 01 17:53:48.371616 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.371577 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:53:48.435269 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.435234 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6zsf\" (UniqueName: \"kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf\") pod \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " Jul 01 17:53:48.435459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.435293 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca\") pod \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " Jul 01 17:53:48.435459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.435393 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert\") pod \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\" (UID: \"3f0c2b12-6f18-4ab1-b29b-f95adb753051\") " Jul 01 17:53:48.437971 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.437895 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf" (OuterVolumeSpecName: "kube-api-access-j6zsf") pod "3f0c2b12-6f18-4ab1-b29b-f95adb753051" (UID: "3f0c2b12-6f18-4ab1-b29b-f95adb753051"). InnerVolumeSpecName "kube-api-access-j6zsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:53:48.441407 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.441377 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "3f0c2b12-6f18-4ab1-b29b-f95adb753051" (UID: "3f0c2b12-6f18-4ab1-b29b-f95adb753051"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:53:48.448855 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.448754 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3f0c2b12-6f18-4ab1-b29b-f95adb753051" (UID: "3f0c2b12-6f18-4ab1-b29b-f95adb753051"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:53:48.536637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.536561 2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3f0c2b12-6f18-4ab1-b29b-f95adb753051-tls-cert\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:53:48.536637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.536590 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6zsf\" (UniqueName: \"kubernetes.io/projected/3f0c2b12-6f18-4ab1-b29b-f95adb753051-kube-api-access-j6zsf\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:53:48.536637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:48.536601 2582 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3f0c2b12-6f18-4ab1-b29b-f95adb753051-oidc-ca\") on node \"ip-10-0-143-173.ec2.internal\" DevicePath \"\"" Jul 01 17:53:49.001247 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.001211 2582 generic.go:356] "Generic (PLEG): container finished" podID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" containerID="c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969" exitCode=0 Jul 01 17:53:49.001680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.001256 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bff4df978-8l7b6" Jul 01 17:53:49.001680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.001292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bff4df978-8l7b6" event={"ID":"3f0c2b12-6f18-4ab1-b29b-f95adb753051","Type":"ContainerDied","Data":"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969"} Jul 01 17:53:49.001680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.001336 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bff4df978-8l7b6" event={"ID":"3f0c2b12-6f18-4ab1-b29b-f95adb753051","Type":"ContainerDied","Data":"0ed91315b671bf2bb10024f2fac9f452874256fad5ad1511a8ae9164cec83665"} Jul 01 17:53:49.001680 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.001357 2582 scope.go:117] "RemoveContainer" containerID="c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969" Jul 01 17:53:49.010461 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.010440 2582 scope.go:117] "RemoveContainer" containerID="c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969" Jul 01 17:53:49.010735 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:53:49.010717 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969\": container with ID starting with c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969 not found: ID does not exist" containerID="c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969" Jul 01 17:53:49.010807 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.010741 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969"} err="failed to get container status \"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969\": rpc error: code = NotFound desc = could not find container \"c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969\": container with ID starting with c7022c8c5cf0b213f6d9dea04cb4fc0474192116f55512ea946b68a1cfe6d969 not found: ID does not exist" Jul 01 17:53:49.050747 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.047119 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:53:49.086098 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:49.086064 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bff4df978-8l7b6"] Jul 01 17:53:50.647242 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:50.647212 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" path="/var/lib/kubelet/pods/3f0c2b12-6f18-4ab1-b29b-f95adb753051/volumes" Jul 01 17:53:54.033017 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:54.032984 2582 generic.go:356] "Generic (PLEG): container finished" podID="34895c85-bfab-47ac-8a13-7993b45d924e" containerID="5755e407aec238ee5a1942c3cc2aa93f5f22690bacb7a097f81c8873155ca70b" exitCode=2 Jul 01 17:53:54.033378 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:54.033056 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerDied","Data":"5755e407aec238ee5a1942c3cc2aa93f5f22690bacb7a097f81c8873155ca70b"} Jul 01 17:53:54.033378 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:54.033361 2582 scope.go:117] "RemoveContainer" containerID="5755e407aec238ee5a1942c3cc2aa93f5f22690bacb7a097f81c8873155ca70b" Jul 01 17:53:55.040154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:55.040119 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerStarted","Data":"a9113d58a81f23a5f2b1f75bbd7e44b8691e8e841d3bb350c63db76e604e9225"} Jul 01 17:53:55.040626 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:53:55.040362 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:54:00.546464 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:00.546438 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:54:00.549789 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:00.549767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:54:00.551805 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:00.551787 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:54:00.555159 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:00.555141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpnd8_8ca1ec6e-c301-4ed2-b33a-ecb61e7654c7/ovn-acl-logging/0.log" Jul 01 17:54:06.047427 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:06.047399 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:54:26.046637 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.046597 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" podUID="34895c85-bfab-47ac-8a13-7993b45d924e" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.47:9004: connect: connection refused" Jul 01 17:54:26.209709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.209626 2582 generic.go:356] "Generic (PLEG): container finished" podID="34895c85-bfab-47ac-8a13-7993b45d924e" containerID="a9113d58a81f23a5f2b1f75bbd7e44b8691e8e841d3bb350c63db76e604e9225" exitCode=2 Jul 01 17:54:26.209709 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.209697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerDied","Data":"a9113d58a81f23a5f2b1f75bbd7e44b8691e8e841d3bb350c63db76e604e9225"} Jul 01 17:54:26.209913 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.209753 2582 scope.go:117] "RemoveContainer" containerID="5755e407aec238ee5a1942c3cc2aa93f5f22690bacb7a097f81c8873155ca70b" Jul 01 17:54:26.210064 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.210043 2582 scope.go:117] "RemoveContainer" containerID="a9113d58a81f23a5f2b1f75bbd7e44b8691e8e841d3bb350c63db76e604e9225" Jul 01 17:54:26.210268 ip-10-0-143-173 kubenswrapper[2582]: E0701 17:54:26.210249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-mrwqc_openshift-ingress(34895c85-bfab-47ac-8a13-7993b45d924e)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" podUID="34895c85-bfab-47ac-8a13-7993b45d924e" Jul 01 17:54:26.376255 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:26.376224 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69949bdb55-89zhj_bf9b41be-2197-4f9e-97b9-7441e4887a11/authorino/0.log" Jul 01 17:54:31.019069 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:31.019036 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d7598f5dc-6kdg9_a99002d4-2249-4187-bcc7-f1993f123fd2/nginx/0.log" Jul 01 17:54:31.472415 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:31.472384 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-668ddc48fb-mjdbn_ec294772-2bdc-4bba-92e9-2eb50e8e50e5/maas-api/0.log" Jul 01 17:54:31.596212 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:31.596182 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c8fb596c-kj4v2_99b224a2-caf9-4e2a-b39b-dfbce585418b/manager/0.log" Jul 01 17:54:31.711841 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:31.711816 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-55chs_4b00f08f-7de3-443c-b30b-5375441adbcb/server/0.log" Jul 01 17:54:32.268621 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:32.268597 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-t65kd_f5b9aadf-a1a0-4225-9b0f-c2fd619e5458/copy-manifests/0.log" Jul 01 17:54:32.282555 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:32.282529 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-t65kd_f5b9aadf-a1a0-4225-9b0f-c2fd619e5458/manager/0.log" Jul 01 17:54:33.743408 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:33.743381 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69949bdb55-89zhj_bf9b41be-2197-4f9e-97b9-7441e4887a11/authorino/0.log" Jul 01 17:54:34.109380 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:34.109354 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bx8z2_b67e9b6d-077e-4a53-9818-999f70866bb4/kuadrant-console-plugin/0.log" Jul 01 17:54:34.238484 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:34.238452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8ssbl_4875d026-b47e-4d05-9bd3-e46a0cc182f7/registry-server/0.log" Jul 01 17:54:34.632084 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:34.632058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xt6lz_dd1e1864-9697-4e4c-bde2-d7f11fe3bd06/manager/0.log" Jul 01 17:54:34.989614 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:34.989531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dxtlk5_9042b84f-0332-4a73-89e9-c0fb78f60295/istio-proxy/0.log" Jul 01 17:54:35.443535 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:35.443505 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/1.log" Jul 01 17:54:35.556779 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:35.556747 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-lxl7s_0d3292a7-9bf3-455a-a1bb-e057de2b2440/payload-pre-processing/0.log" Jul 01 17:54:35.670341 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:35.670312 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/1.log" Jul 01 17:54:35.791948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:35.791864 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-779fb6d48c-h7x8z_1940f1cd-db39-442f-9911-ba9c760be227/router/0.log" Jul 01 17:54:36.046524 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.046433 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:54:36.047018 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.046971 2582 scope.go:117] "RemoveContainer" containerID="a9113d58a81f23a5f2b1f75bbd7e44b8691e8e841d3bb350c63db76e604e9225" Jul 01 17:54:36.264201 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.264168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" event={"ID":"34895c85-bfab-47ac-8a13-7993b45d924e","Type":"ContainerStarted","Data":"f3ac915a8ad09c5845e4bb36f1f38759291cd1b7c099198b06a04b81fb9441ad"} Jul 01 17:54:36.264393 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.264378 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:54:36.388437 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.388410 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-drlzl_0d60a900-fbbe-4e4b-9b91-688d6befcb44/main/0.log" Jul 01 17:54:36.628154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:36.628123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-t87xg_f16e7206-82c2-43ac-9b0a-7f75cfb248e5/main/0.log" Jul 01 17:54:44.023783 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:44.023744 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-76qms_9d88c438-47ec-4856-ac7a-5afa4057e1d7/global-pull-secret-syncer/0.log" Jul 01 17:54:44.263687 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:44.263656 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z5bvt_06444d6d-8efb-484c-95bd-86946c7b39c5/konnectivity-agent/0.log" Jul 01 17:54:44.379558 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:44.379525 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-173.ec2.internal_5d49aadf2d9d721fc3745139ad40d239/haproxy/0.log" Jul 01 17:54:47.272020 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:47.271989 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-mrwqc" Jul 01 17:54:48.920563 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:48.920536 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69949bdb55-89zhj_bf9b41be-2197-4f9e-97b9-7441e4887a11/authorino/0.log" Jul 01 17:54:49.070998 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:49.070973 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bx8z2_b67e9b6d-077e-4a53-9818-999f70866bb4/kuadrant-console-plugin/0.log" Jul 01 17:54:49.124169 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:49.124135 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8ssbl_4875d026-b47e-4d05-9bd3-e46a0cc182f7/registry-server/0.log" Jul 01 17:54:49.284149 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:49.284123 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xt6lz_dd1e1864-9697-4e4c-bde2-d7f11fe3bd06/manager/0.log" Jul 01 17:54:50.831475 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:50.831449 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/alertmanager/0.log" Jul 01 17:54:50.876539 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:50.876512 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/config-reloader/0.log" Jul 01 17:54:50.921809 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:50.921782 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/kube-rbac-proxy-web/0.log" Jul 01 17:54:50.975347 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:50.975327 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/kube-rbac-proxy/0.log" Jul 01 17:54:51.016956 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.016923 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/kube-rbac-proxy-metric/0.log" Jul 01 17:54:51.054693 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.054673 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/prom-label-proxy/0.log" Jul 01 17:54:51.089773 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.089704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc529793-21e7-46db-9922-caf0548e2e33/init-config-reloader/0.log" Jul 01 17:54:51.303422 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.303395 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-664b977cd7-hw6zx_eb485617-09f3-4852-a179-de93d09d3237/metrics-server/0.log" Jul 01 17:54:51.414239 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.414214 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4bz4_77d78569-464b-471a-ad00-2cd7df273770/node-exporter/0.log" Jul 01 17:54:51.449694 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.449663 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4bz4_77d78569-464b-471a-ad00-2cd7df273770/kube-rbac-proxy/0.log" Jul 01 17:54:51.481923 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.481900 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h4bz4_77d78569-464b-471a-ad00-2cd7df273770/init-textfile/0.log" Jul 01 17:54:51.702378 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.702283 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mq8mv_a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc/kube-rbac-proxy-main/0.log" Jul 01 17:54:51.730749 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.730723 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mq8mv_a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc/kube-rbac-proxy-self/0.log" Jul 01 17:54:51.778249 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:51.778204 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-mq8mv_a97ec78b-6e57-43c9-b6c0-efd60b7f9bcc/openshift-state-metrics/0.log" Jul 01 17:54:52.076948 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.076915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-ckmvs_2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a/prometheus-operator/0.log" Jul 01 17:54:52.100867 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.100846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-ckmvs_2890d0c5-5cc4-42a7-8774-2bbcef2a4f0a/kube-rbac-proxy/0.log" Jul 01 17:54:52.132246 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.132219 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-8kztw_a66efd11-252c-4c8a-bff1-8de1acd970ec/prometheus-operator-admission-webhook/0.log" Jul 01 17:54:52.169890 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.169869 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f685dfbdd-ppfxf_0856f460-ddbc-40c4-8752-cd832da18bba/telemeter-client/0.log" Jul 01 17:54:52.202116 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.202081 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f685dfbdd-ppfxf_0856f460-ddbc-40c4-8752-cd832da18bba/reload/0.log" Jul 01 17:54:52.228076 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:52.228045 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f685dfbdd-ppfxf_0856f460-ddbc-40c4-8752-cd832da18bba/kube-rbac-proxy/0.log" Jul 01 17:54:54.328915 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:54.328888 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/2.log" Jul 01 17:54:54.335740 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:54.335704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-x745c_b3890b79-5861-42e5-993c-f0149d88f872/console-operator/3.log" Jul 01 17:54:54.871393 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:54.871364 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76df69f9cf-7sdkr_f2273874-7ce2-4795-94de-c721bdceda51/console/0.log" Jul 01 17:54:54.940598 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:54.940571 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-7n8xj_ef9ec5da-cfb3-485d-9cda-db90884789e9/download-server/0.log" Jul 01 17:54:56.854192 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:56.854163 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j78qx_14dc4286-a8fe-4124-8775-8430f68dbde0/dns/0.log" Jul 01 17:54:56.883002 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:56.882975 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j78qx_14dc4286-a8fe-4124-8775-8430f68dbde0/kube-rbac-proxy/0.log" Jul 01 17:54:57.065329 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.065303 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r4mqk_07410fd2-0491-4ebd-8579-0608736e1ffd/dns-node-resolver/0.log" Jul 01 17:54:57.542684 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.542655 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2"] Jul 01 17:54:57.543140 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.543126 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" containerName="authorino" Jul 01 17:54:57.543200 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.543142 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" containerName="authorino" Jul 01 17:54:57.543261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.543248 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0c2b12-6f18-4ab1-b29b-f95adb753051" containerName="authorino" Jul 01 17:54:57.546508 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.546490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.549582 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.549562 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jskq7\"/\"kube-root-ca.crt\"" Jul 01 17:54:57.550737 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.550724 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jskq7\"/\"default-dockercfg-rcm95\"" Jul 01 17:54:57.550737 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.550728 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jskq7\"/\"openshift-service-ca.crt\"" Jul 01 17:54:57.557293 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.557272 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2"] Jul 01 17:54:57.693190 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.693161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvpk5\" (UniqueName: \"kubernetes.io/projected/76c87b54-c6d9-4402-b714-327caba6ebf7-kube-api-access-jvpk5\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.693359 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.693201 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-podres\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.693359 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.693223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-sys\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.693359 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.693317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-proc\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.693465 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.693418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-lib-modules\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.773809 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.773778 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-84764d44d6-lqst7_81edd9a8-973e-4a3e-aaa3-92178d6ce74d/registry/0.log" Jul 01 17:54:57.794459 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-proc\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-lib-modules\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794495 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-proc\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvpk5\" (UniqueName: \"kubernetes.io/projected/76c87b54-c6d9-4402-b714-327caba6ebf7-kube-api-access-jvpk5\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-podres\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794588 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-sys\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794775 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794591 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-lib-modules\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794775 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-sys\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.794775 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.794646 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76c87b54-c6d9-4402-b714-327caba6ebf7-podres\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.808154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.808133 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvpk5\" (UniqueName: \"kubernetes.io/projected/76c87b54-c6d9-4402-b714-327caba6ebf7-kube-api-access-jvpk5\") pod \"perf-node-gather-daemonset-zq6w2\" (UID: \"76c87b54-c6d9-4402-b714-327caba6ebf7\") " pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.857975 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.857933 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:57.954388 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:57.954334 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtw7n_fa3b046d-06d1-44f3-b607-bc66fa0cfe19/node-ca/0.log" Jul 01 17:54:58.015180 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:58.015154 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2"] Jul 01 17:54:58.015382 ip-10-0-143-173 kubenswrapper[2582]: W0701 17:54:58.015362 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76c87b54_c6d9_4402_b714_327caba6ebf7.slice/crio-4cb3e178608fefbf89e8d8cdd49c70b5b84ba7febee9888e5b959ab1d8701943 WatchSource:0}: Error finding container 4cb3e178608fefbf89e8d8cdd49c70b5b84ba7febee9888e5b959ab1d8701943: Status 404 returned error can't find the container with id 4cb3e178608fefbf89e8d8cdd49c70b5b84ba7febee9888e5b959ab1d8701943 Jul 01 17:54:58.385485 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:58.385397 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" event={"ID":"76c87b54-c6d9-4402-b714-327caba6ebf7","Type":"ContainerStarted","Data":"f2f03a2ff5f13d16bac041a226918ded8c21eaa83bc65314a95620da639c48f0"} Jul 01 17:54:58.385618 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:58.385496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" event={"ID":"76c87b54-c6d9-4402-b714-327caba6ebf7","Type":"ContainerStarted","Data":"4cb3e178608fefbf89e8d8cdd49c70b5b84ba7febee9888e5b959ab1d8701943"} Jul 01 17:54:58.385618 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:58.385527 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:54:58.418658 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:58.418605 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" podStartSLOduration=1.41859196 podStartE2EDuration="1.41859196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:54:58.417196113 +0000 UTC m=+958.410465317" watchObservedRunningTime="2026-07-01 17:54:58.41859196 +0000 UTC m=+958.411861151" Jul 01 17:54:59.119670 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.119636 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dxtlk5_9042b84f-0332-4a73-89e9-c0fb78f60295/istio-proxy/0.log" Jul 01 17:54:59.292814 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.292785 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/1.log" Jul 01 17:54:59.293375 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.293354 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/0.log" Jul 01 17:54:59.318964 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.318927 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-lxl7s_0d3292a7-9bf3-455a-a1bb-e057de2b2440/payload-pre-processing/0.log" Jul 01 17:54:59.349374 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.349339 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/2.log" Jul 01 17:54:59.350376 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.350349 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/1.log" Jul 01 17:54:59.375971 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:54:59.375868 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-779fb6d48c-h7x8z_1940f1cd-db39-442f-9911-ba9c760be227/router/0.log" Jul 01 17:55:00.136970 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.136913 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vpn5c_9bbf845c-c0b0-410b-aa7a-76f42a2ed7a3/serve-healthcheck-canary/0.log" Jul 01 17:55:00.663306 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.663270 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fhzzz_e223c107-1c49-422a-b857-6a8dc9e880f3/insights-operator/1.log" Jul 01 17:55:00.663595 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.663310 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fhzzz_e223c107-1c49-422a-b857-6a8dc9e880f3/insights-operator/0.log" Jul 01 17:55:00.695616 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.695593 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7d629_97d8bef7-b286-441f-8d62-d78b5e54f5bf/kube-rbac-proxy/0.log" Jul 01 17:55:00.733518 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.733485 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7d629_97d8bef7-b286-441f-8d62-d78b5e54f5bf/exporter/0.log" Jul 01 17:55:00.763924 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:00.763900 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7d629_97d8bef7-b286-441f-8d62-d78b5e54f5bf/extractor/0.log" Jul 01 17:55:03.930276 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:03.930249 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7d7598f5dc-6kdg9_a99002d4-2249-4187-bcc7-f1993f123fd2/nginx/0.log" Jul 01 17:55:04.137352 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.137316 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-668ddc48fb-mjdbn_ec294772-2bdc-4bba-92e9-2eb50e8e50e5/maas-api/0.log" Jul 01 17:55:04.181625 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.181549 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c8fb596c-kj4v2_99b224a2-caf9-4e2a-b39b-dfbce585418b/manager/0.log" Jul 01 17:55:04.213177 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.213153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-55chs_4b00f08f-7de3-443c-b30b-5375441adbcb/server/0.log" Jul 01 17:55:04.292290 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.292264 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dxtlk5_9042b84f-0332-4a73-89e9-c0fb78f60295/istio-proxy/0.log" Jul 01 17:55:04.401133 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.401108 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jskq7/perf-node-gather-daemonset-zq6w2" Jul 01 17:55:04.482105 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.482009 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/1.log" Jul 01 17:55:04.482460 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.482439 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/0.log" Jul 01 17:55:04.499840 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.499807 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-lxl7s_0d3292a7-9bf3-455a-a1bb-e057de2b2440/payload-pre-processing/0.log" Jul 01 17:55:04.524427 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.524398 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/2.log" Jul 01 17:55:04.525564 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.525546 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/1.log" Jul 01 17:55:04.544821 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.544800 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-779fb6d48c-h7x8z_1940f1cd-db39-442f-9911-ba9c760be227/router/0.log" Jul 01 17:55:04.576337 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.576173 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-t65kd_f5b9aadf-a1a0-4225-9b0f-c2fd619e5458/manager/0.log" Jul 01 17:55:04.620506 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:04.620481 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c9b6b59-t65kd_f5b9aadf-a1a0-4225-9b0f-c2fd619e5458/copy-manifests/0.log" Jul 01 17:55:05.636837 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.636804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dxtlk5_9042b84f-0332-4a73-89e9-c0fb78f60295/istio-proxy/0.log" Jul 01 17:55:05.802721 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.802697 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/1.log" Jul 01 17:55:05.802999 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.802983 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-qjxdx_1433dabf-dc03-4668-b518-52db3caf7d7d/istio-proxy/0.log" Jul 01 17:55:05.831752 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.831728 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-lxl7s_0d3292a7-9bf3-455a-a1bb-e057de2b2440/payload-pre-processing/0.log" Jul 01 17:55:05.867954 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.867910 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/2.log" Jul 01 17:55:05.868984 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.868966 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-mrwqc_34895c85-bfab-47ac-8a13-7993b45d924e/payload-processing/1.log" Jul 01 17:55:05.902012 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:05.901931 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-779fb6d48c-h7x8z_1940f1cd-db39-442f-9911-ba9c760be227/router/0.log" Jul 01 17:55:06.207044 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:06.206926 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6599c59cb5-vbvq4_981d9f11-e72a-43aa-949e-491c12c4f41b/manager/0.log" Jul 01 17:55:06.244227 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:06.244203 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rbfxs_87ab3f33-6fd8-4b55-b9f0-03373997c4d8/openshift-lws-operator/0.log" Jul 01 17:55:13.219606 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.219572 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/kube-multus-additional-cni-plugins/0.log" Jul 01 17:55:13.254340 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.254319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/egress-router-binary-copy/0.log" Jul 01 17:55:13.288509 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.288491 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/cni-plugins/0.log" Jul 01 17:55:13.326029 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.326006 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/bond-cni-plugin/0.log" Jul 01 17:55:13.363154 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.363134 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/routeoverride-cni/0.log" Jul 01 17:55:13.410261 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.410241 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/whereabouts-cni-bincopy/0.log" Jul 01 17:55:13.448981 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.448958 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptjvf_dffb5813-61bd-49ef-b937-10afd0f20e03/whereabouts-cni/0.log" Jul 01 17:55:13.801058 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.801030 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xns2r_a8be83b4-e3b0-43ae-85af-307b34017cfe/kube-multus/0.log" Jul 01 17:55:13.830647 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.830624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvc7c_14b36aa2-0485-454c-ab34-2c4dd547ae10/network-metrics-daemon/0.log" Jul 01 17:55:13.859506 ip-10-0-143-173 kubenswrapper[2582]: I0701 17:55:13.859483 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cvc7c_14b36aa2-0485-454c-ab34-2c4dd547ae10/kube-rbac-proxy/0.log"