Jul 23 04:39:06.665011 ip-10-0-139-3 systemd[1]: Starting Kubernetes Kubelet... Jul 23 04:39:06.990512 ip-10-0-139-3 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 04:39:06.990512 ip-10-0-139-3 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 04:39:06.990512 ip-10-0-139-3 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 04:39:06.990512 ip-10-0-139-3 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 04:39:06.990512 ip-10-0-139-3 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 04:39:06.991241 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.990579 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 04:39:06.995135 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995114 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:06.995135 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995134 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995139 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995142 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995145 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995148 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995150 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995153 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995162 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995164 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995167 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995169 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995172 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995175 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995177 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995180 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995183 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995185 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995187 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995190 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995192 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:06.995203 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995196 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995200 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995204 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995206 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995209 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995212 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995215 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995218 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995220 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995224 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995227 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995230 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995233 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995236 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995239 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995242 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995245 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995249 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995252 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:06.995692 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995255 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995257 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995260 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995262 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995265 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995267 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995270 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995272 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995276 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995279 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995282 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995284 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995286 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995289 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995291 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995295 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995299 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995301 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995304 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995306 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:06.996148 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995308 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995311 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995313 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995316 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995318 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995320 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995323 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995326 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995328 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995331 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995333 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995339 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995341 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995344 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995346 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995349 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995352 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995356 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995358 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995361 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:06.996614 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995364 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995366 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995368 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995371 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995373 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995376 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995378 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995381 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995384 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995387 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995390 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995392 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995395 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995397 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995400 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995402 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995405 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995407 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.995409 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996150 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:06.997097 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996157 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996160 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996163 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996165 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996168 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996171 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996173 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996176 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996178 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996180 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996184 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996186 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996189 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996191 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996193 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996196 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996198 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996201 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996203 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996207 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:06.997560 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996210 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996212 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996215 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996217 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996220 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996222 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996224 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996229 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996232 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996235 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996238 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996241 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996243 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996246 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996249 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996252 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996254 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996257 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996260 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996263 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:06.998061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996265 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996268 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996270 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996273 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996275 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996278 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996280 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996283 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996285 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996289 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996292 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996295 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996298 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996301 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996303 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996306 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996309 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996311 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996313 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996316 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:06.998535 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996318 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996321 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996323 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996325 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996328 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996330 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996332 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996335 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996337 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996339 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996342 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996344 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996347 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996349 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996352 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996354 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996357 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996360 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996364 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:06.999027 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996366 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996369 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996371 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996375 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996380 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996383 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996385 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996388 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996411 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996415 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996418 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996421 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996423 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996426 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996428 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996431 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996433 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996436 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996439 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:06.999477 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996901 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996907 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996911 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996914 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996917 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996920 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996922 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996925 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996927 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996930 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996935 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996940 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996943 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996946 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996948 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996951 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996954 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996956 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996959 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:06.999971 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996961 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996963 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996966 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996968 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996971 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996973 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996975 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996978 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996980 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996982 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996985 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996987 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996989 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996992 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996994 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996996 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.996999 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997001 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997004 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:07.000427 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997007 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997010 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997013 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997020 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997022 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997025 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997028 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997033 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997036 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997038 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997040 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997043 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997045 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997048 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997050 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997052 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997055 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997057 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997059 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997062 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:07.000900 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997064 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997066 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997068 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997071 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997073 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997075 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997078 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997080 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997082 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997085 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997087 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997090 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997094 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997097 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997099 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997105 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997108 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997111 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997113 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997116 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:07.001390 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997118 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997120 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997123 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997125 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997127 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997130 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997132 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997134 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997137 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997139 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997142 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997144 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997147 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997149 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997152 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997154 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997156 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997158 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997161 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997163 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997165 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:07.001875 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997242 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997252 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997263 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997269 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997277 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997282 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997290 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997296 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997299 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997302 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997306 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997309 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997312 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997315 2570 flags.go:64] FLAG: --cgroup-root="" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997318 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997321 2570 flags.go:64] FLAG: --client-ca-file="" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997323 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997326 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997331 2570 flags.go:64] FLAG: --cluster-domain="" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997333 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997336 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997339 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997342 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997347 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 04:39:07.002349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997350 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997353 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997356 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997359 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997362 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997364 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997370 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997372 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997377 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997380 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997382 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997385 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997388 2570 flags.go:64] FLAG: --enable-server="true" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997391 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997399 2570 flags.go:64] FLAG: --event-burst="100" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997402 2570 flags.go:64] FLAG: --event-qps="50" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997405 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997407 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997410 2570 flags.go:64] FLAG: --eviction-hard="" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997414 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997417 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997420 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997423 2570 flags.go:64] FLAG: --eviction-soft="" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997425 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997428 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 04:39:07.002943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997432 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997434 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997438 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997440 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997443 2570 flags.go:64] FLAG: --feature-gates="" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997447 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997449 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997453 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997456 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997458 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997461 2570 flags.go:64] FLAG: --help="false" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997464 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997467 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997471 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997474 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997477 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997480 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997483 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997485 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997488 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997491 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997495 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997498 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997501 2570 flags.go:64] FLAG: --kube-reserved="" Jul 23 04:39:07.003560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997504 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997507 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997510 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997512 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997515 2570 flags.go:64] FLAG: --lock-file="" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997517 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997520 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997523 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997529 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997532 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997534 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997537 2570 flags.go:64] FLAG: --logging-format="text" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997540 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997543 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997546 2570 flags.go:64] FLAG: --manifest-url="" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997549 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997553 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997556 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997560 2570 flags.go:64] FLAG: --max-pods="110" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997563 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997566 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997570 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997573 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997576 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997578 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 04:39:07.004149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997581 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997588 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997592 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997595 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997600 2570 flags.go:64] FLAG: --pod-cidr="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997603 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997609 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997612 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997629 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997632 2570 flags.go:64] FLAG: --port="10250" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997635 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997638 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0be3708353619cae1" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997641 2570 flags.go:64] FLAG: --qos-reserved="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997644 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997647 2570 flags.go:64] FLAG: --register-node="true" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997650 2570 flags.go:64] FLAG: --register-with-taints="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997653 2570 flags.go:64] FLAG: --registry-burst="10" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997656 2570 flags.go:64] FLAG: --registry-qps="5" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997659 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997661 2570 flags.go:64] FLAG: --reserved-memory="" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997665 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997668 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997671 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997674 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997677 2570 flags.go:64] FLAG: --runonce="false" Jul 23 04:39:07.004824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997680 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997683 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997686 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997694 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997696 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997699 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997702 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997705 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997708 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997711 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997714 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997716 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997721 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997725 2570 flags.go:64] FLAG: --system-cgroups="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997728 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997733 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997736 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997739 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997742 2570 flags.go:64] FLAG: --tls-min-version="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997744 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997747 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997750 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997752 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997755 2570 flags.go:64] FLAG: --v="2" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997759 2570 flags.go:64] FLAG: --version="false" Jul 23 04:39:07.005423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997763 2570 flags.go:64] FLAG: --vmodule="" Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997766 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.997769 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997919 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997922 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997926 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997928 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997931 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997934 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997936 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997940 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997943 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997945 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997948 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997950 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997952 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997955 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997957 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997960 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:07.006054 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997963 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997966 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997989 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997993 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997995 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.997998 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998000 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998003 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998005 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998008 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998011 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998013 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998015 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998018 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998020 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998024 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998028 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998031 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998034 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998036 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:07.006514 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998039 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998041 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998044 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998049 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998052 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998054 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998058 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998062 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998065 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998068 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998071 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998074 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998078 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998080 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998083 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998087 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998089 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998092 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998095 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998097 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:07.007005 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998100 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998102 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998105 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998107 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998109 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998112 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998114 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998116 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998119 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998121 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998124 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998126 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998128 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998131 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998133 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998136 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998139 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998141 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998143 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998146 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:07.007480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998148 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998150 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998153 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998155 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998159 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998162 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998164 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998167 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998170 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998172 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998174 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998177 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998179 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998182 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998184 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998186 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998189 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998191 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998194 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:07.007976 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998197 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998200 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998203 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:06.998205 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:06.998724 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.005925 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.005942 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.005960 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.005966 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006035 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006041 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006045 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006048 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006051 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006054 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:07.008538 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006057 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006059 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006062 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006065 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006068 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006071 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006080 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006083 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006085 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006088 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006094 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006096 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006099 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006101 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006104 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006106 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006109 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006111 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006114 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006116 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:07.009029 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006119 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006122 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006124 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006128 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006130 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006133 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006135 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006138 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006142 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006145 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006147 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006149 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006152 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006154 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006156 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006158 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006161 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006163 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006166 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006173 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:07.009491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006176 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006179 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006181 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006184 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006186 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006188 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006191 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006193 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006195 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006198 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006200 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006202 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006205 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006207 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006210 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006213 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006215 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006218 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006228 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:07.010014 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006231 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006234 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006237 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006240 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006242 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006244 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006247 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006249 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006252 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006254 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006256 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006259 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006261 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006270 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006273 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006275 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006278 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006280 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006282 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006285 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:07.010452 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006287 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006290 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006292 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006294 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006296 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006300 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006303 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006305 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006309 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006311 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006314 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006316 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006319 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006321 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.006326 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 04:39:07.010949 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006479 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006484 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006486 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006489 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006491 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006494 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006496 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006499 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006501 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006504 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006506 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006514 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006516 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006519 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006522 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006524 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006527 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006529 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006532 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006534 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 04:39:07.011315 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006536 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006539 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006541 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006543 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006546 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006548 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006551 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006553 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006555 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006558 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006560 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006562 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006566 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006569 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006572 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006574 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006577 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006579 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006581 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006584 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 23 04:39:07.011784 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006586 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006588 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006591 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006593 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006605 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006607 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006610 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006612 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006628 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006630 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006634 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006638 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006641 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006643 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006646 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006648 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006651 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006653 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006656 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 04:39:07.012265 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006658 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006660 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006663 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006665 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006667 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006670 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006672 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006674 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006676 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006678 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006681 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006683 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006686 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006688 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006690 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006693 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006695 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006697 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006705 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006708 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 04:39:07.012724 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006711 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006714 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006717 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006720 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006723 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006725 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006728 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006730 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006732 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006736 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006738 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006740 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006743 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006745 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006747 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006749 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006752 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006754 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006756 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 04:39:07.013199 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:07.006759 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.006763 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.006896 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.010248 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.011422 2570 server.go:1019] "Starting client certificate rotation" Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.011527 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 04:39:07.013657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.011563 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 04:39:07.015024 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.015007 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 04:39:07.019161 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.019132 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 04:39:07.028074 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.028049 2570 log.go:25] "Validated CRI v1 runtime API" Jul 23 04:39:07.030119 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.030103 2570 log.go:25] "Validated CRI v1 image API" Jul 23 04:39:07.030983 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.030967 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 04:39:07.033453 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.033432 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a819fcf0-04b3-42bc-892a-fe079d812cd5:/dev/nvme0n1p4 b02eabdf-1b2b-4c83-aa2a-a8e69eb95246:/dev/nvme0n1p3] Jul 23 04:39:07.033520 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.033451 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 04:39:07.038397 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.038281 2570 manager.go:216] Machine: {Timestamp:2026-07-23 04:39:07.037180931 +0000 UTC m=+0.273222177 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197085 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f4e15da64cbeab1a4dffad6af99ff SystemUUID:ec2f4e15-da64-cbea-b1a4-dffad6af99ff BootID:13e9af77-b779-47b2-acbb-90ef2fa0ac46 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:46:29:31:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:46:29:31:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:be:5f:29:21:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 04:39:07.038397 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.038393 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 04:39:07.038504 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.038478 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 04:39:07.041295 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.041266 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 04:39:07.041437 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.041299 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 04:39:07.041974 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.041954 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 04:39:07.041974 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.041978 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 04:39:07.042041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.041986 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 04:39:07.042630 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.042609 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 04:39:07.043989 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.043975 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 04:39:07.046915 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.046897 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 04:39:07.047902 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.047890 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 23 04:39:07.048101 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048090 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 04:39:07.048148 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048124 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 23 04:39:07.048148 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048136 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 04:39:07.048212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048151 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 04:39:07.048212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048161 2570 kubelet.go:398] "Adding apiserver pod source" Jul 23 04:39:07.048212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048169 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 04:39:07.048565 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048554 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 04:39:07.048597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.048572 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 04:39:07.050438 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.050420 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 04:39:07.052649 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.052611 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 04:39:07.052696 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.052667 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 04:39:07.053668 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053656 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 04:39:07.053704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053672 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 04:39:07.053704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053679 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 04:39:07.053704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053684 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 04:39:07.053704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053696 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 04:39:07.053704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053703 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053718 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053726 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053734 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053739 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053748 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 04:39:07.053818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.053753 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 04:39:07.054944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.054929 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 04:39:07.055017 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.054948 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 04:39:07.058375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.058359 2570 server.go:1268] "Started kubelet" Jul 23 04:39:07.058926 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.058445 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 04:39:07.059019 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.058949 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 04:39:07.059581 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.059384 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 04:39:07.059581 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.059439 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 04:39:07.059749 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.059678 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 04:39:07.059749 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.059680 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 04:39:07.059784 ip-10-0-139-3 systemd[1]: Started Kubernetes Kubelet. Jul 23 04:39:07.062210 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.062187 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 04:39:07.062557 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.062539 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 23 04:39:07.065541 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.065522 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 04:39:07.066141 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.065272 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18c4d15c6215664f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-07-23 04:39:07.058325071 +0000 UTC m=+0.294366319,LastTimestamp:2026-07-23 04:39:07.058325071 +0000 UTC m=+0.294366319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Jul 23 04:39:07.069454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.069434 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 04:39:07.069454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.069445 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 04:39:07.069747 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.069729 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.070149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070135 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 04:39:07.070252 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070135 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 04:39:07.070315 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070308 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 04:39:07.070398 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070362 2570 factory.go:55] Registering systemd factory Jul 23 04:39:07.070398 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070383 2570 factory.go:223] Registration of the systemd container factory successfully Jul 23 04:39:07.070546 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070475 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 23 04:39:07.070546 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070485 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 23 04:39:07.070677 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070633 2570 factory.go:153] Registering CRI-O factory Jul 23 04:39:07.070677 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070647 2570 factory.go:223] Registration of the crio container factory successfully Jul 23 04:39:07.070738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070698 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 04:39:07.070738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070719 2570 factory.go:103] Registering Raw factory Jul 23 04:39:07.070738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.070732 2570 manager.go:1196] Started watching for new ooms in manager Jul 23 04:39:07.071069 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.071057 2570 manager.go:349] Starting recovery of all containers Jul 23 04:39:07.080122 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.080086 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 04:39:07.080261 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.080230 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 04:39:07.081023 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.081004 2570 manager.go:354] Recovery completed Jul 23 04:39:07.086465 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.086339 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.088468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.088453 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.088527 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.088484 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.088527 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.088498 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.089145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089130 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 04:39:07.089145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089143 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 04:39:07.089249 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089155 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.089249 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089158 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 23 04:39:07.089901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089886 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.089992 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089915 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.089992 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.089929 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.091370 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.091356 2570 policy_none.go:49] "None policy: Start" Jul 23 04:39:07.091436 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.091376 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 04:39:07.091436 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.091390 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 04:39:07.093342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.093328 2570 policy_none.go:47] "Start" Jul 23 04:39:07.096297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.096277 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbsdc" Jul 23 04:39:07.097602 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.097304 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18c4d15c63e15d35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-07-23 04:39:07.088469301 +0000 UTC m=+0.324510550,LastTimestamp:2026-07-23 04:39:07.088469301 +0000 UTC m=+0.324510550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Jul 23 04:39:07.099178 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.099080 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18c4d15c63e1b3d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-3.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-07-23 04:39:07.088491475 +0000 UTC m=+0.324532722,LastTimestamp:2026-07-23 04:39:07.088491475 +0000 UTC m=+0.324532722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Jul 23 04:39:07.105549 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.105529 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbsdc" Jul 23 04:39:07.106833 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.106764 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-3.ec2.internal.18c4d15c63e1db03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-3.ec2.internal,UID:ip-10-0-139-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-3.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-3.ec2.internal,},FirstTimestamp:2026-07-23 04:39:07.088501507 +0000 UTC m=+0.324542753,LastTimestamp:2026-07-23 04:39:07.088501507 +0000 UTC m=+0.324542753,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-3.ec2.internal,}" Jul 23 04:39:07.140121 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140104 2570 manager.go:337] "Starting Device Plugin manager" Jul 23 04:39:07.140206 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.140152 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 04:39:07.140206 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140166 2570 server.go:87] "Starting device plugin registration server" Jul 23 04:39:07.140478 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140465 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 04:39:07.140538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140478 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 04:39:07.140588 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140565 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 04:39:07.140686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140668 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 04:39:07.140686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.140685 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 04:39:07.141238 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.141222 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 04:39:07.141333 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.141265 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.170533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.170485 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 04:39:07.176963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.171856 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 04:39:07.176963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.171896 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 04:39:07.176963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.171918 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 04:39:07.176963 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.171950 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 04:39:07.176963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.174282 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 04:39:07.241660 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.241550 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.243473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.242822 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.243473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.242855 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.243473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.242869 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.243473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.242933 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.253493 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.253465 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.253493 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.253494 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-3.ec2.internal\": node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.272074 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.272039 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal"] Jul 23 04:39:07.272241 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.272117 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.273119 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.273097 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.273213 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.273130 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.273213 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.273141 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.275410 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.275395 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.275509 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.275493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.275541 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.275525 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.276171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276157 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.276264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276177 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.276264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276184 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.276264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276196 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.276264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276207 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.276264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.276197 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.277097 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.277077 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.278392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.278376 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.278467 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.278402 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:07.279132 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.279118 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:07.279208 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.279140 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:07.279208 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.279149 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:07.303500 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.303474 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-3.ec2.internal\" not found" node="ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.308266 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.308248 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-3.ec2.internal\" not found" node="ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.377551 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.377519 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.471921 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.471890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.471921 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.471923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.472091 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.471948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96fd72404baf0a9d1f61b80c08212cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"96fd72404baf0a9d1f61b80c08212cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.478006 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.477981 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.572866 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572772 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.572866 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572782 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.572866 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.573051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96fd72404baf0a9d1f61b80c08212cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"96fd72404baf0a9d1f61b80c08212cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.573051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572914 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96fd72404baf0a9d1f61b80c08212cf9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-3.ec2.internal\" (UID: \"96fd72404baf0a9d1f61b80c08212cf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.573051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.572913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577b7b7cbbefade1bc59f82b2fa69520-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal\" (UID: \"577b7b7cbbefade1bc59f82b2fa69520\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.578863 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.578837 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.607052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.607024 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.611937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:07.611900 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:07.678960 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.678905 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.779562 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.779512 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.880061 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.880010 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:07.980782 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:07.980750 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:08.011733 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.011692 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 04:39:08.012242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.011918 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 04:39:08.068739 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.068701 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 04:39:08.081966 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:08.081924 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:08.110257 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.110210 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 04:34:07 +0000 UTC" deadline="2028-04-09 00:44:14.741122586 +0000 UTC" Jul 23 04:39:08.110257 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.110248 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15020h5m6.630878759s" Jul 23 04:39:08.182721 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:08.182683 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:08.256877 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.256838 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 04:39:08.258907 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.258881 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientMemory" Jul 23 04:39:08.259051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.258925 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 04:39:08.259051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.258939 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeHasSufficientPID" Jul 23 04:39:08.268011 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:08.267979 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577b7b7cbbefade1bc59f82b2fa69520.slice/crio-96a6c0f28e667b63ac066c6a4a2f6bbe3e078e5c57bd56dde561fa96c3f8a5e1 WatchSource:0}: Error finding container 96a6c0f28e667b63ac066c6a4a2f6bbe3e078e5c57bd56dde561fa96c3f8a5e1: Status 404 returned error can't find the container with id 96a6c0f28e667b63ac066c6a4a2f6bbe3e078e5c57bd56dde561fa96c3f8a5e1 Jul 23 04:39:08.276227 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.276208 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 04:39:08.282238 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:08.282203 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fd72404baf0a9d1f61b80c08212cf9.slice/crio-bfdd65ffe58618be932e93730e31ebe71a7b2feaaafc1139823b2e6e53af4bbe WatchSource:0}: Error finding container bfdd65ffe58618be932e93730e31ebe71a7b2feaaafc1139823b2e6e53af4bbe: Status 404 returned error can't find the container with id bfdd65ffe58618be932e93730e31ebe71a7b2feaaafc1139823b2e6e53af4bbe Jul 23 04:39:08.282758 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:08.282743 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:08.383395 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:08.383353 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-3.ec2.internal\" not found" Jul 23 04:39:08.404963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.404892 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 04:39:08.473042 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.472975 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" Jul 23 04:39:08.489031 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.489003 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 04:39:08.489989 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.489973 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" Jul 23 04:39:08.499485 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.499459 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 04:39:08.612941 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:08.612907 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 04:39:09.049828 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.049793 2570 apiserver.go:52] "Watching apiserver" Jul 23 04:39:09.056459 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.056241 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 04:39:09.056762 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.056716 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-xbft6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal","openshift-multus/multus-8trqw","openshift-multus/network-metrics-daemon-pcswx","openshift-network-diagnostics/network-check-target-k5zgz","kube-system/konnectivity-agent-2mrb8","kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn","openshift-multus/multus-additional-cni-plugins-25tw7","openshift-network-operator/iptables-alerter-7hj8q","openshift-ovn-kubernetes/ovnkube-node-45j69","kube-system/global-pull-secret-syncer-wllts","openshift-cluster-node-tuning-operator/tuned-v7wcc","openshift-dns/node-resolver-9lfrx"] Jul 23 04:39:09.059608 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.059571 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.063193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.062592 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.063193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.062630 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 04:39:09.063193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.062878 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.063193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.062973 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.063193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.063023 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cxb56\"" Jul 23 04:39:09.065869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.064961 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.065869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.065040 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.065869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.065382 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.065869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.065666 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4w578\"" Jul 23 04:39:09.067393 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067370 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.067524 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067508 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 04:39:09.067726 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067684 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.067800 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067737 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2wvc\"" Jul 23 04:39:09.068033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067859 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 04:39:09.068033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.067866 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.068033 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.067930 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:09.070153 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.070043 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:09.070153 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.070115 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:09.070918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.070831 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 04:39:09.072861 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.072486 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.075629 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.075114 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.075629 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.075413 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9mvsc\"" Jul 23 04:39:09.075629 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.075435 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 04:39:09.075873 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.075678 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.085832 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.085904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25wkc\" (UniqueName: \"kubernetes.io/projected/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-kube-api-access-25wkc\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.085943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-conf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.085974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-kubelet\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-multus-certs\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b636121-f124-4497-879f-5d1e7f68fecf-konnectivity-ca\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086107 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-netns\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-run\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-bin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-multus\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086238 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-host\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086261 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-cni-binary-copy\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-daemon-config\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086295 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 04:39:09.087164 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-tmp\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086353 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-cnibin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-conf-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086394 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-etc-kubernetes\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086452 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-host-slash\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysconfig\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086503 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-systemd\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-sys\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086549 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-lib-modules\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-os-release\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddpcz\" (UniqueName: \"kubernetes.io/projected/03d0e1b3-9879-44fa-b159-20f5aa944865-kube-api-access-ddpcz\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086621 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-socket-dir-parent\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-iptables-alerter-script\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-kubernetes\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-var-lib-kubelet\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpjf\" (UniqueName: \"kubernetes.io/projected/65718be0-28ee-46f8-bae5-e73fd1cb94fe-kube-api-access-hdpjf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086781 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-hostroot\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmg6\" (UniqueName: \"kubernetes.io/projected/aacb3060-88cb-44f2-9e1d-5635b5ae4506-kube-api-access-tsmg6\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b636121-f124-4497-879f-5d1e7f68fecf-agent-certs\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086863 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-modprobe-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-tuned\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-system-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.086929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-k8s-cni-cncf-io\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.088910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.087716 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 04:39:09.090924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.089512 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.090924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.089554 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.090924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.089915 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 04:39:09.090924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.090116 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hcpg6\"" Jul 23 04:39:09.090924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.090195 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f8gxv\"" Jul 23 04:39:09.092777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.092075 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.094547 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.094528 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.094671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.094553 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 04:39:09.094671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.094574 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fvr45\"" Jul 23 04:39:09.095294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.095260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.095983 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.095965 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.098392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.098368 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4vhtm\"" Jul 23 04:39:09.098678 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.098640 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.098903 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.098883 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 04:39:09.099154 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.098976 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.099510 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.099445 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.101126 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.100827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.101126 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.100938 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:09.101941 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.101917 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 04:39:09.102534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.102515 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 04:39:09.102609 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.102566 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 04:39:09.102667 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.102612 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 04:39:09.102823 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.102795 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 04:39:09.103120 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.103097 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z9sns\"" Jul 23 04:39:09.103259 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.103100 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 04:39:09.107162 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.107139 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4zs7" Jul 23 04:39:09.114735 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.114709 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4zs7" Jul 23 04:39:09.171591 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.171564 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 04:39:09.179030 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.178966 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" event={"ID":"96fd72404baf0a9d1f61b80c08212cf9","Type":"ContainerStarted","Data":"bfdd65ffe58618be932e93730e31ebe71a7b2feaaafc1139823b2e6e53af4bbe"} Jul 23 04:39:09.182461 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.182411 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"577b7b7cbbefade1bc59f82b2fa69520","Type":"ContainerStarted","Data":"96a6c0f28e667b63ac066c6a4a2f6bbe3e078e5c57bd56dde561fa96c3f8a5e1"} Jul 23 04:39:09.187706 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-tuned\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187711 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-system-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25wkc\" (UniqueName: \"kubernetes.io/projected/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-kube-api-access-25wkc\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-multus-certs\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187808 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b636121-f124-4497-879f-5d1e7f68fecf-konnectivity-ca\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.187860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187837 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-system-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-os-release\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-netns\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187890 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-multus-certs\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187905 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-run\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.187980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-ovn\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188038 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cnibin\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188067 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-host\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188084 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-cni-binary-copy\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188098 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 04:39:09.188168 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188123 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5j5q\" (UniqueName: \"kubernetes.io/projected/db588ac8-e5ff-4986-aa27-0649ffabbd0a-kube-api-access-v5j5q\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188182 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2620eb17-054f-467e-9105-6729202cd9fe-ovn-node-metrics-cert\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-dbus\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-system-cni-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188179 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-netns\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.188265 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188285 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-tmp\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188322 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-cnibin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.188370 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:09.688336834 +0000 UTC m=+2.924378069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-conf-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188386 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-cnibin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188455 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-etc-kubernetes\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.188885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188482 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190260 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db588ac8-e5ff-4986-aa27-0649ffabbd0a-serviceca\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-host-slash\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-systemd\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-lib-modules\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-os-release\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190522 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddpcz\" (UniqueName: \"kubernetes.io/projected/03d0e1b3-9879-44fa-b159-20f5aa944865-kube-api-access-ddpcz\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xwn8\" (UniqueName: \"kubernetes.io/projected/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-kube-api-access-2xwn8\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-socket-dir-parent\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.190780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.190671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-kubernetes\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191030 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-host\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-os-release\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191127 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-conf-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191197 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-host-slash\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191243 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-systemd\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.191289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191261 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-lib-modules\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.191531 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191321 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-etc-kubernetes\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.191919 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.191897 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-socket-dir-parent\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.192099 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.192070 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b636121-f124-4497-879f-5d1e7f68fecf-konnectivity-ca\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.192166 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.188107 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-run\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.192416 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-kubernetes\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.192801 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-cni-binary-copy\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.194864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-var-lib-kubelet\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.194913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpjf\" (UniqueName: \"kubernetes.io/projected/65718be0-28ee-46f8-bae5-e73fd1cb94fe-kube-api-access-hdpjf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.194972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-hostroot\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195006 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmg6\" (UniqueName: \"kubernetes.io/projected/aacb3060-88cb-44f2-9e1d-5635b5ae4506-kube-api-access-tsmg6\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-kubelet\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-netns\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-device-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-k8s-cni-cncf-io\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195297 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-systemd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195335 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-var-lib-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195379 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-kubelet-config\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwm7\" (UniqueName: \"kubernetes.io/projected/1637e59a-281b-4834-b25e-82499e756235-kube-api-access-qxwm7\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.198614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-conf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195510 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-kubelet\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195569 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvljg\" (UniqueName: \"kubernetes.io/projected/2620eb17-054f-467e-9105-6729202cd9fe-kube-api-access-bvljg\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-binary-copy\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195636 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-bin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-multus\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.195938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-systemd-units\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-log-socket\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196048 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-daemon-config\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054885b4-fca9-4be3-911e-ac40fe21741c-tmp-dir\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196145 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196197 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-env-overrides\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:09.199544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/054885b4-fca9-4be3-911e-ac40fe21741c-hosts-file\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-config\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196368 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-hostroot\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196476 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db588ac8-e5ff-4986-aa27-0649ffabbd0a-host\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196528 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-etc-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysconfig\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-sys\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b636121-f124-4497-879f-5d1e7f68fecf-agent-certs\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196673 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysconfig\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196740 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-node-log\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196813 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-run-k8s-cni-cncf-io\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-kubelet\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.196915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-sys\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.199216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-bin\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.199292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-host-var-lib-cni-multus\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.199362 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-var-lib-kubelet\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.199962 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-daemon-config\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.200354 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200234 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-sysctl-conf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-iptables-alerter-script\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-script-lib\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200562 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200602 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-modprobe-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvct\" (UniqueName: \"kubernetes.io/projected/054885b4-fca9-4be3-911e-ac40fe21741c-kube-api-access-hqvct\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-slash\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200793 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-bin\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.201185 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.200822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-netd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.201651 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.201546 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-iptables-alerter-script\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.201759 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.201722 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-modprobe-d\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.202488 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.202463 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d0e1b3-9879-44fa-b159-20f5aa944865-multus-cni-dir\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.203729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.202889 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-etc-tuned\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.203729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.203432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b636121-f124-4497-879f-5d1e7f68fecf-agent-certs\") pod \"konnectivity-agent-2mrb8\" (UID: \"6b636121-f124-4497-879f-5d1e7f68fecf\") " pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.207400 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.207371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddpcz\" (UniqueName: \"kubernetes.io/projected/03d0e1b3-9879-44fa-b159-20f5aa944865-kube-api-access-ddpcz\") pod \"multus-8trqw\" (UID: \"03d0e1b3-9879-44fa-b159-20f5aa944865\") " pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.209187 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.209162 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25wkc\" (UniqueName: \"kubernetes.io/projected/d4fd45b6-88c6-4ec6-8eb9-1298060e92e8-kube-api-access-25wkc\") pod \"iptables-alerter-7hj8q\" (UID: \"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8\") " pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.212422 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.212404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65718be0-28ee-46f8-bae5-e73fd1cb94fe-tmp\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.212791 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.212768 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:09.212888 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.212797 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:09.212888 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.212813 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:09.212888 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.212886 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:09.712865765 +0000 UTC m=+2.948907021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:09.213273 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.213253 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpjf\" (UniqueName: \"kubernetes.io/projected/65718be0-28ee-46f8-bae5-e73fd1cb94fe-kube-api-access-hdpjf\") pod \"tuned-v7wcc\" (UID: \"65718be0-28ee-46f8-bae5-e73fd1cb94fe\") " pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.218092 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.217997 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmg6\" (UniqueName: \"kubernetes.io/projected/aacb3060-88cb-44f2-9e1d-5635b5ae4506-kube-api-access-tsmg6\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.302183 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302183 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-script-lib\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302183 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302194 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvct\" (UniqueName: \"kubernetes.io/projected/054885b4-fca9-4be3-911e-ac40fe21741c-kube-api-access-hqvct\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-slash\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-bin\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-netd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302360 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-os-release\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-ovn\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302441 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cnibin\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5j5q\" (UniqueName: \"kubernetes.io/projected/db588ac8-e5ff-4986-aa27-0649ffabbd0a-kube-api-access-v5j5q\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302493 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2620eb17-054f-467e-9105-6729202cd9fe-ovn-node-metrics-cert\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302521 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-dbus\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-system-cni-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db588ac8-e5ff-4986-aa27-0649ffabbd0a-serviceca\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302638 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xwn8\" (UniqueName: \"kubernetes.io/projected/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-kube-api-access-2xwn8\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302725 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-kubelet\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302750 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-netns\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-device-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-systemd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-var-lib-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302870 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-kubelet-config\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302926 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwm7\" (UniqueName: \"kubernetes.io/projected/1637e59a-281b-4834-b25e-82499e756235-kube-api-access-qxwm7\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.302954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvljg\" (UniqueName: \"kubernetes.io/projected/2620eb17-054f-467e-9105-6729202cd9fe-kube-api-access-bvljg\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.302983 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-binary-copy\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-systemd-units\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-log-socket\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303119 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054885b4-fca9-4be3-911e-ac40fe21741c-tmp-dir\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303143 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303168 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-env-overrides\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303235 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/054885b4-fca9-4be3-911e-ac40fe21741c-hosts-file\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-config\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303285 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303307 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db588ac8-e5ff-4986-aa27-0649ffabbd0a-host\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-etc-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-node-log\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.303525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303485 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-node-log\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303543 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-device-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.304242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.303912 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.304349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304276 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-script-lib\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304350 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-systemd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304371 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.304488 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-var-lib-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304488 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304457 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-kubelet-config\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.304587 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.304678 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304644 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-slash\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304819 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304723 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304819 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304745 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-dbus\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.304819 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304785 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-run-ovn\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.304819 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304806 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304843 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-bin\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304859 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-socket-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304889 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-cni-netd\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-etc-selinux\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304959 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-os-release\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-systemd-units\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.304982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-system-cni-dir\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.305045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305046 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-run-netns\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305273 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-env-overrides\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305370 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/054885b4-fca9-4be3-911e-ac40fe21741c-hosts-file\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.305537 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305453 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054885b4-fca9-4be3-911e-ac40fe21741c-tmp-dir\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.305537 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-log-socket\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305634 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db588ac8-e5ff-4986-aa27-0649ffabbd0a-host\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.305634 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305574 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.305634 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305625 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-sys-fs\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.305818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305637 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-host-kubelet\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305685 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1637e59a-281b-4834-b25e-82499e756235-registration-dir\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.305918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305879 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2620eb17-054f-467e-9105-6729202cd9fe-ovnkube-config\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305972 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305928 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2620eb17-054f-467e-9105-6729202cd9fe-etc-openvswitch\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.305972 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.305939 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cnibin\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.306088 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.306020 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:09.306137 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.306097 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db588ac8-e5ff-4986-aa27-0649ffabbd0a-serviceca\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.306278 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.306194 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:09.806173138 +0000 UTC m=+3.042214394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:09.306278 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.306250 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-cni-binary-copy\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.309530 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.309506 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2620eb17-054f-467e-9105-6729202cd9fe-ovn-node-metrics-cert\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.318071 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.318041 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvct\" (UniqueName: \"kubernetes.io/projected/054885b4-fca9-4be3-911e-ac40fe21741c-kube-api-access-hqvct\") pod \"node-resolver-9lfrx\" (UID: \"054885b4-fca9-4be3-911e-ac40fe21741c\") " pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.322815 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.322776 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xwn8\" (UniqueName: \"kubernetes.io/projected/6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77-kube-api-access-2xwn8\") pod \"multus-additional-cni-plugins-25tw7\" (UID: \"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77\") " pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.323051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.323031 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvljg\" (UniqueName: \"kubernetes.io/projected/2620eb17-054f-467e-9105-6729202cd9fe-kube-api-access-bvljg\") pod \"ovnkube-node-45j69\" (UID: \"2620eb17-054f-467e-9105-6729202cd9fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.323381 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.323361 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5j5q\" (UniqueName: \"kubernetes.io/projected/db588ac8-e5ff-4986-aa27-0649ffabbd0a-kube-api-access-v5j5q\") pod \"node-ca-xbft6\" (UID: \"db588ac8-e5ff-4986-aa27-0649ffabbd0a\") " pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.324573 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.324548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwm7\" (UniqueName: \"kubernetes.io/projected/1637e59a-281b-4834-b25e-82499e756235-kube-api-access-qxwm7\") pod \"aws-ebs-csi-driver-node-zjfgn\" (UID: \"1637e59a-281b-4834-b25e-82499e756235\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.378009 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.377975 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7hj8q" Jul 23 04:39:09.390212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.390172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" Jul 23 04:39:09.404945 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.404908 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8trqw" Jul 23 04:39:09.422475 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.422435 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:09.428787 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.428759 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25tw7" Jul 23 04:39:09.438387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.438108 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9lfrx" Jul 23 04:39:09.445616 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.445394 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" Jul 23 04:39:09.452509 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.452470 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xbft6" Jul 23 04:39:09.459924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.459885 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:09.533287 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.533248 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 04:39:09.707193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.707157 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:09.707353 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.707294 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:09.707414 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.707355 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:10.70734083 +0000 UTC m=+3.943382080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:09.807942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.807900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:09.808134 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:09.807994 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:09.808134 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808073 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:09.808134 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808127 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:09.808305 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808146 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:09.808305 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808159 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:09.808305 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808167 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:10.808144654 +0000 UTC m=+4.044185910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:09.808305 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:09.808214 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:10.808197444 +0000 UTC m=+4.044238684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:10.118462 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:10.118419 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 04:34:09 +0000 UTC" deadline="2027-12-16 23:36:06.432366762 +0000 UTC" Jul 23 04:39:10.118462 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:10.118462 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12282h56m56.313910335s" Jul 23 04:39:10.444918 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.444823 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d0e1b3_9879_44fa_b159_20f5aa944865.slice/crio-44bada3dec52fba29aa5df269cd37846be96f07a2df7de6d4dc19965b1f36774 WatchSource:0}: Error finding container 44bada3dec52fba29aa5df269cd37846be96f07a2df7de6d4dc19965b1f36774: Status 404 returned error can't find the container with id 44bada3dec52fba29aa5df269cd37846be96f07a2df7de6d4dc19965b1f36774 Jul 23 04:39:10.446973 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.446940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fd45b6_88c6_4ec6_8eb9_1298060e92e8.slice/crio-b3fd777a0b4221664a365b5d33efc7ae169c72bfab0c212ddea00e6428e90319 WatchSource:0}: Error finding container b3fd777a0b4221664a365b5d33efc7ae169c72bfab0c212ddea00e6428e90319: Status 404 returned error can't find the container with id b3fd777a0b4221664a365b5d33efc7ae169c72bfab0c212ddea00e6428e90319 Jul 23 04:39:10.468942 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.468916 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65718be0_28ee_46f8_bae5_e73fd1cb94fe.slice/crio-2065cec472691c48400fc28718248b345c1ac3accd9ffe95f1dab67839b4a01b WatchSource:0}: Error finding container 2065cec472691c48400fc28718248b345c1ac3accd9ffe95f1dab67839b4a01b: Status 404 returned error can't find the container with id 2065cec472691c48400fc28718248b345c1ac3accd9ffe95f1dab67839b4a01b Jul 23 04:39:10.470285 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.470263 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2620eb17_054f_467e_9105_6729202cd9fe.slice/crio-08bdb5e805cf1d8de6a2342543733d81c02563e49df4db34a2d3efb8c9c3cf80 WatchSource:0}: Error finding container 08bdb5e805cf1d8de6a2342543733d81c02563e49df4db34a2d3efb8c9c3cf80: Status 404 returned error can't find the container with id 08bdb5e805cf1d8de6a2342543733d81c02563e49df4db34a2d3efb8c9c3cf80 Jul 23 04:39:10.473170 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.472243 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b636121_f124_4497_879f_5d1e7f68fecf.slice/crio-7193d71decffc02a52ee257dafb0450868eca7beec2a613bbae811278568c612 WatchSource:0}: Error finding container 7193d71decffc02a52ee257dafb0450868eca7beec2a613bbae811278568c612: Status 404 returned error can't find the container with id 7193d71decffc02a52ee257dafb0450868eca7beec2a613bbae811278568c612 Jul 23 04:39:10.474294 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.474261 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054885b4_fca9_4be3_911e_ac40fe21741c.slice/crio-b50e9f6783ca44841e6c76f33313f942d3b1e8498ea3bb6b0492e75b67af36d1 WatchSource:0}: Error finding container b50e9f6783ca44841e6c76f33313f942d3b1e8498ea3bb6b0492e75b67af36d1: Status 404 returned error can't find the container with id b50e9f6783ca44841e6c76f33313f942d3b1e8498ea3bb6b0492e75b67af36d1 Jul 23 04:39:10.474823 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.474800 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2a91b5_e4b9_4e0c_8852_c90bc98d4c77.slice/crio-4d187e0c29a0ab4eb93042ecbfaaf80b9e2e516b6e49436080b2aca0249462ed WatchSource:0}: Error finding container 4d187e0c29a0ab4eb93042ecbfaaf80b9e2e516b6e49436080b2aca0249462ed: Status 404 returned error can't find the container with id 4d187e0c29a0ab4eb93042ecbfaaf80b9e2e516b6e49436080b2aca0249462ed Jul 23 04:39:10.475552 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.475519 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1637e59a_281b_4834_b25e_82499e756235.slice/crio-54ae2040c70e3865259d81febec3f1f9903bd9c1b2c7a30ee4db77a6789d9a78 WatchSource:0}: Error finding container 54ae2040c70e3865259d81febec3f1f9903bd9c1b2c7a30ee4db77a6789d9a78: Status 404 returned error can't find the container with id 54ae2040c70e3865259d81febec3f1f9903bd9c1b2c7a30ee4db77a6789d9a78 Jul 23 04:39:10.476376 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:10.476352 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb588ac8_e5ff_4986_aa27_0649ffabbd0a.slice/crio-5a595efa5182ac4a07f4cb669c99b182d9c8b53beb06553e3a7eab8d10687afe WatchSource:0}: Error finding container 5a595efa5182ac4a07f4cb669c99b182d9c8b53beb06553e3a7eab8d10687afe: Status 404 returned error can't find the container with id 5a595efa5182ac4a07f4cb669c99b182d9c8b53beb06553e3a7eab8d10687afe Jul 23 04:39:10.714064 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:10.714025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:10.714368 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.714211 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:10.714368 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.714301 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:12.714278996 +0000 UTC m=+5.950320236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:10.815899 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:10.815849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:10.816102 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:10.815920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:10.816102 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816032 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:10.816102 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816060 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:10.816102 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816031 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:10.816102 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816071 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:10.816327 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816149 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:12.816126678 +0000 UTC m=+6.052167933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:10.816327 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:10.816170 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:12.816160147 +0000 UTC m=+6.052201390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:11.119179 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.119104 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 04:34:09 +0000 UTC" deadline="2028-04-04 07:37:43.648815978 +0000 UTC" Jul 23 04:39:11.119179 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.119177 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14906h58m32.529643872s" Jul 23 04:39:11.172215 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.172178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:11.172399 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:11.172315 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:11.172833 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.172806 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:11.172975 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:11.172917 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:11.173041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.172991 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:11.173103 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:11.173087 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:11.191125 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.191090 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" event={"ID":"1637e59a-281b-4834-b25e-82499e756235","Type":"ContainerStarted","Data":"54ae2040c70e3865259d81febec3f1f9903bd9c1b2c7a30ee4db77a6789d9a78"} Jul 23 04:39:11.196107 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.196066 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerStarted","Data":"4d187e0c29a0ab4eb93042ecbfaaf80b9e2e516b6e49436080b2aca0249462ed"} Jul 23 04:39:11.198244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.198207 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mrb8" event={"ID":"6b636121-f124-4497-879f-5d1e7f68fecf","Type":"ContainerStarted","Data":"7193d71decffc02a52ee257dafb0450868eca7beec2a613bbae811278568c612"} Jul 23 04:39:11.201886 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.201849 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hj8q" event={"ID":"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8","Type":"ContainerStarted","Data":"b3fd777a0b4221664a365b5d33efc7ae169c72bfab0c212ddea00e6428e90319"} Jul 23 04:39:11.206424 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.206360 2570 generic.go:356] "Generic (PLEG): container finished" podID="577b7b7cbbefade1bc59f82b2fa69520" containerID="772f2e5ba180ec0b9fa5cf18d34c679872a2bf9fb6e25e15f2e663149eaf221e" exitCode=0 Jul 23 04:39:11.206558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.206455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"577b7b7cbbefade1bc59f82b2fa69520","Type":"ContainerDied","Data":"772f2e5ba180ec0b9fa5cf18d34c679872a2bf9fb6e25e15f2e663149eaf221e"} Jul 23 04:39:11.209300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.209254 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9lfrx" event={"ID":"054885b4-fca9-4be3-911e-ac40fe21741c","Type":"ContainerStarted","Data":"b50e9f6783ca44841e6c76f33313f942d3b1e8498ea3bb6b0492e75b67af36d1"} Jul 23 04:39:11.212961 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.212931 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"08bdb5e805cf1d8de6a2342543733d81c02563e49df4db34a2d3efb8c9c3cf80"} Jul 23 04:39:11.215363 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.215333 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" event={"ID":"65718be0-28ee-46f8-bae5-e73fd1cb94fe","Type":"ContainerStarted","Data":"2065cec472691c48400fc28718248b345c1ac3accd9ffe95f1dab67839b4a01b"} Jul 23 04:39:11.231635 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.231595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8trqw" event={"ID":"03d0e1b3-9879-44fa-b159-20f5aa944865","Type":"ContainerStarted","Data":"44bada3dec52fba29aa5df269cd37846be96f07a2df7de6d4dc19965b1f36774"} Jul 23 04:39:11.242194 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.241239 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" event={"ID":"96fd72404baf0a9d1f61b80c08212cf9","Type":"ContainerStarted","Data":"a04a1d6af5dff9fe0f02eb2011631b152bed6c466f38a7bff49047869114b2b3"} Jul 23 04:39:11.245867 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:11.245771 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xbft6" event={"ID":"db588ac8-e5ff-4986-aa27-0649ffabbd0a","Type":"ContainerStarted","Data":"5a595efa5182ac4a07f4cb669c99b182d9c8b53beb06553e3a7eab8d10687afe"} Jul 23 04:39:12.262313 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:12.262075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" event={"ID":"577b7b7cbbefade1bc59f82b2fa69520","Type":"ContainerStarted","Data":"f3cdcf786b1af9c7794cb69e3f5fdf5ef7172d82cb43829fef49a304b2e09bcd"} Jul 23 04:39:12.281201 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:12.280109 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-3.ec2.internal" podStartSLOduration=3.280082515 podStartE2EDuration="3.280082515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:11.264228035 +0000 UTC m=+4.500269297" watchObservedRunningTime="2026-07-23 04:39:12.280082515 +0000 UTC m=+5.516123778" Jul 23 04:39:12.735706 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:12.735065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:12.735706 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.735255 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:12.735706 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.735327 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:16.735304247 +0000 UTC m=+9.971345487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:12.836443 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:12.836395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:12.836648 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:12.836492 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:12.836757 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.836708 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:12.836757 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.836732 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:12.836757 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.836746 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:12.836909 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.836810 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:16.836789085 +0000 UTC m=+10.072830347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:12.837276 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.837253 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:12.837392 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:12.837317 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:16.837300394 +0000 UTC m=+10.073341646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:13.175798 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:13.175762 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:13.175982 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:13.175916 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:13.176342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:13.176317 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:13.176558 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:13.176477 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:13.176558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:13.176535 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:13.176720 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:13.176622 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:15.174666 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:15.174839 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:15.175241 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:15.175329 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:15.175384 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:15.175528 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:15.175469 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:16.773091 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:16.773047 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:16.773584 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.773235 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:16.773584 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.773304 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:24.773284396 +0000 UTC m=+18.009325636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:16.873533 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:16.873620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.873804 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.873861 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:24.873846643 +0000 UTC m=+18.109887883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.874227 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.874250 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.874263 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:16.874344 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:16.874301 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:24.87428803 +0000 UTC m=+18.110329281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:17.173807 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:17.173950 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:17.174284 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:17.174403 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:17.174465 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:17.175883 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:17.174584 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:19.172963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:19.172926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:19.173424 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:19.172980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:19.173424 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:19.172925 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:19.173424 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:19.173148 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:19.173424 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:19.173228 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:19.173424 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:19.173307 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:21.172792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:21.172929 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:21.172792 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:21.173032 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:21.173071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:21.173297 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:21.173128 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:23.172529 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:23.172491 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:23.172529 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:23.172529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:23.173071 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:23.172491 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:23.173071 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:23.172643 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:23.173071 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:23.172736 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:23.173071 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:23.172838 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:24.839784 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:24.839745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:24.840341 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.839926 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:24.840341 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.840004 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:40.839983478 +0000 UTC m=+34.076024907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:24.940330 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:24.940297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:24.940484 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:24.940355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:24.940484 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940456 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:24.940484 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940468 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:24.940484 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940484 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:24.940641 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940496 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:24.940641 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940520 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:39:40.940501156 +0000 UTC m=+34.176542414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:24.940641 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:24.940538 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:39:40.940529385 +0000 UTC m=+34.176570623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:25.173000 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:25.172955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:25.173000 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:25.173002 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:25.173244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:25.172973 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:25.173244 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:25.173078 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:25.173244 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:25.173170 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:25.173365 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:25.173251 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:27.173954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:27.173804 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:27.173954 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:27.173886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:27.173954 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:27.173909 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:27.174518 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:27.174015 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:27.174518 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:27.174035 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:27.174518 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:27.174138 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:29.175955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:29.175924 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:29.175955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:29.175955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:29.176560 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:29.176030 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:29.176560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:29.176094 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:29.176560 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:29.176170 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:29.176560 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:29.176228 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:30.302907 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.301978 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9lfrx" event={"ID":"054885b4-fca9-4be3-911e-ac40fe21741c","Type":"ContainerStarted","Data":"74bed19e3b38c7043066c4cde5b8cc46d78c6833e66e48a281bfaac2f2eceb5a"} Jul 23 04:39:30.308671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.307883 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" event={"ID":"65718be0-28ee-46f8-bae5-e73fd1cb94fe","Type":"ContainerStarted","Data":"aaf530209040d02811c7dc4ed1a67d41480d58be44be5ef3bff31b18f6c9d3e7"} Jul 23 04:39:30.318869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.318817 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-3.ec2.internal" podStartSLOduration=21.318774902 podStartE2EDuration="21.318774902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:12.281142571 +0000 UTC m=+5.517183834" watchObservedRunningTime="2026-07-23 04:39:30.318774902 +0000 UTC m=+23.554816160" Jul 23 04:39:30.320030 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.319985 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9lfrx" podStartSLOduration=2.690632416 podStartE2EDuration="22.319966243s" totalImagesPullingTime="19.629333827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:30.318712864 +0000 UTC m=+23.554754123" watchObservedRunningTime="2026-07-23 04:39:30.319966243 +0000 UTC m=+23.556007588" Jul 23 04:39:30.321339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.321058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mrb8" event={"ID":"6b636121-f124-4497-879f-5d1e7f68fecf","Type":"ContainerStarted","Data":"131c5d63332ba60c4b1dbf80bc0aafd18da3c19cacc23a90a85d6e884ab94a74"} Jul 23 04:39:30.360608 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.360481 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xbft6" podStartSLOduration=2.737067986 podStartE2EDuration="22.360459058s" totalImagesPullingTime="19.623391072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:30.359811214 +0000 UTC m=+23.595852484" watchObservedRunningTime="2026-07-23 04:39:30.360459058 +0000 UTC m=+23.596500315" Jul 23 04:39:30.376128 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.376082 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v7wcc" podStartSLOduration=2.72719537 podStartE2EDuration="22.376065152s" totalImagesPullingTime="19.648869782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:30.375767376 +0000 UTC m=+23.611808633" watchObservedRunningTime="2026-07-23 04:39:30.376065152 +0000 UTC m=+23.612106409" Jul 23 04:39:30.391842 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:30.391799 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mrb8" podStartSLOduration=7.1222012 podStartE2EDuration="22.391782594s" totalImagesPullingTime="15.269581394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:30.39125937 +0000 UTC m=+23.627300626" watchObservedRunningTime="2026-07-23 04:39:30.391782594 +0000 UTC m=+23.627823851" Jul 23 04:39:31.172680 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.172398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:31.172858 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.172495 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:31.172858 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:31.172797 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:31.172858 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.172524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:31.173008 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:31.172869 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:31.173008 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:31.172919 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:31.327770 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327729 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"762093d4046cdd1d80a350a3836e2a7eb62bff9809c593377bdeb2932240142f"} Jul 23 04:39:31.328492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327808 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"9865c0099bff8c4414ed95634b5c5c2d055a3274af987c3a8c01eddff32bc971"} Jul 23 04:39:31.328492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327842 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"13af3cf1c188ee9f4566c68425bb35ba6baddd8a445375d99cdbc67882302719"} Jul 23 04:39:31.328492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"6605e66492d7b69db291b93fdc8c13d28b0c091477e0b4d2186ec2c2dc18be5a"} Jul 23 04:39:31.328492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327906 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"4b126fab46196db21078a42d515a60c775116102d7c0fc99bd58b2833f630e01"} Jul 23 04:39:31.328492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.327943 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"2cb87392444de902dfe4cfade3f717db7aa6446a720d8bf8208a39c253430fa0"} Jul 23 04:39:31.329107 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.329086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8trqw" event={"ID":"03d0e1b3-9879-44fa-b159-20f5aa944865","Type":"ContainerStarted","Data":"98b32db2a5d215649da0b66b3f0797394637104e2e172be5ebdfc1a4cfc98f95"} Jul 23 04:39:31.330414 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.330390 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xbft6" event={"ID":"db588ac8-e5ff-4986-aa27-0649ffabbd0a","Type":"ContainerStarted","Data":"5413817ac41661a86aa6cc4c2ee56d84a15ca90982108c7a4c321993b3d686a9"} Jul 23 04:39:31.331785 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.331761 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" event={"ID":"1637e59a-281b-4834-b25e-82499e756235","Type":"ContainerStarted","Data":"b5254de1bc407085a0856d2fbd7bd53c46344036572725679ce0480d5c32c941"} Jul 23 04:39:31.333024 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.333002 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="fb12404680cf5e41837234a95ef75cc13ac2fd5d59ee00709647204adc2f7d71" exitCode=0 Jul 23 04:39:31.333101 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.333080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"fb12404680cf5e41837234a95ef75cc13ac2fd5d59ee00709647204adc2f7d71"} Jul 23 04:39:31.349311 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.349267 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8trqw" podStartSLOduration=3.644714566 podStartE2EDuration="23.349252537s" totalImagesPullingTime="19.704537971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:31.349192902 +0000 UTC m=+24.585234158" watchObservedRunningTime="2026-07-23 04:39:31.349252537 +0000 UTC m=+24.585293793" Jul 23 04:39:31.696436 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:31.696394 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 04:39:32.163006 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.162893 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T04:39:31.696431242Z","UUID":"50f6aad6-3e14-49d4-9fbe-1b75c0eeeba9","Handler":null,"Name":"","Endpoint":""} Jul 23 04:39:32.164844 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.164812 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 04:39:32.165003 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.164852 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 04:39:32.339377 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.339342 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" event={"ID":"1637e59a-281b-4834-b25e-82499e756235","Type":"ContainerStarted","Data":"b7f0d7c488f67a7f06903c00f24432c1e820a5411076312d1f5dec5d88a4c6b0"} Jul 23 04:39:32.342392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.342368 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7hj8q" event={"ID":"d4fd45b6-88c6-4ec6-8eb9-1298060e92e8","Type":"ContainerStarted","Data":"c1394d6b7113e9305859789d8997c8bfcb1cec4aabeed95fe5f523076b661983"} Jul 23 04:39:32.359057 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:32.359001 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7hj8q" podStartSLOduration=4.716806519 podStartE2EDuration="24.358982006s" totalImagesPullingTime="19.642175487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:32.35844903 +0000 UTC m=+25.594490286" watchObservedRunningTime="2026-07-23 04:39:32.358982006 +0000 UTC m=+25.595023262" Jul 23 04:39:33.172406 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.172318 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:33.172406 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.172327 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:33.172768 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.172327 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:33.172768 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:33.172464 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:33.172768 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:33.172569 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:33.172768 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:33.172697 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:33.348393 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.348354 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"785c0697f3b6f1a68d8f9411944bc0a762a960207e7b44c127d2b3bf2ffecb67"} Jul 23 04:39:33.350729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.350693 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" event={"ID":"1637e59a-281b-4834-b25e-82499e756235","Type":"ContainerStarted","Data":"c5ba088bd87ac1eb51c558e0bb8d0087a018e963d79f6ee92bb2c3fd34655ea3"} Jul 23 04:39:33.372546 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:33.372488 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zjfgn" podStartSLOduration=3.29651646 podStartE2EDuration="25.372469509s" totalImagesPullingTime="22.075953049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:33.372395441 +0000 UTC m=+26.608436701" watchObservedRunningTime="2026-07-23 04:39:33.372469509 +0000 UTC m=+26.608510747" Jul 23 04:39:34.845558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:34.845515 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:34.846169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:34.846148 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:35.172434 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:35.172434 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:35.172561 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:35.172444 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:35.172687 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:35.172951 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:35.172738 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:35.355109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:35.355047 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:35.355661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:35.355638 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mrb8" Jul 23 04:39:36.358658 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:36.358449 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="6282e16592694d8e099642508c734010fe87c52cbcd6661bdf4b6bbbaf742063" exitCode=0 Jul 23 04:39:36.359473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:36.358531 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"6282e16592694d8e099642508c734010fe87c52cbcd6661bdf4b6bbbaf742063"} Jul 23 04:39:36.362716 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:36.362689 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" event={"ID":"2620eb17-054f-467e-9105-6729202cd9fe","Type":"ContainerStarted","Data":"2ad3c6ea765c828f6e6d87ea83a7ee67503f7d48c5310732399177cabe310354"} Jul 23 04:39:36.445322 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:36.444758 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" podStartSLOduration=8.74392718 podStartE2EDuration="28.444736601s" totalImagesPullingTime="19.700809421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:36.443835626 +0000 UTC m=+29.679876885" watchObservedRunningTime="2026-07-23 04:39:36.444736601 +0000 UTC m=+29.680777858" Jul 23 04:39:37.173400 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.173365 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:37.173722 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.173487 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:37.173722 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.173533 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:37.173722 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.173589 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:37.173722 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.173696 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:37.173986 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.173789 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:37.365705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.365666 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:37.366571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.366550 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:37.366719 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.366613 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:37.383150 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.382970 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:37.383294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.383244 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:39:37.613424 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.613386 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wllts"] Jul 23 04:39:37.613639 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.613606 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:37.614048 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.613819 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:37.615740 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.615342 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pcswx"] Jul 23 04:39:37.615740 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.615501 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:37.615926 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.615725 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:37.617205 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.617183 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k5zgz"] Jul 23 04:39:37.617304 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:37.617275 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:37.617365 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:37.617347 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:38.369436 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:38.369404 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="9b31ec707c2138317bc995e8a6777d3cc5ed3bfa158477dac09b76b04f5cb3eb" exitCode=0 Jul 23 04:39:38.369837 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:38.369477 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"9b31ec707c2138317bc995e8a6777d3cc5ed3bfa158477dac09b76b04f5cb3eb"} Jul 23 04:39:39.172678 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:39.172631 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:39.172830 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:39.172684 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:39.172830 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:39.172640 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:39.172830 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:39.172761 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:39.172973 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:39.172880 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:39.172973 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:39.172961 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:40.375884 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:40.375847 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="964eb506b7197ac912d3e402beb1a2069c3e9c4170584dbf556c50a4255e6012" exitCode=0 Jul 23 04:39:40.376330 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:40.375914 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"964eb506b7197ac912d3e402beb1a2069c3e9c4170584dbf556c50a4255e6012"} Jul 23 04:39:40.862020 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:40.861977 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:40.862213 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.862153 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:40.862279 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.862232 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:12.862215098 +0000 UTC m=+66.098256346 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 04:39:40.962798 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:40.962764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:40.962964 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:40.962831 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:40.962964 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.962949 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:40.962964 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.962952 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 04:39:40.963124 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.962981 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 04:39:40.963124 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.962992 2570 projected.go:196] Error preparing data for projected volume kube-api-access-vpv6r for pod openshift-network-diagnostics/network-check-target-k5zgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:40.963124 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.963011 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret podName:4cb7174a-e1f8-4b2b-8c2e-70a38284943c nodeName:}" failed. No retries permitted until 2026-07-23 04:40:12.962993425 +0000 UTC m=+66.199034675 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret") pod "global-pull-secret-syncer-wllts" (UID: "4cb7174a-e1f8-4b2b-8c2e-70a38284943c") : object "kube-system"/"original-pull-secret" not registered Jul 23 04:39:40.963124 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:40.963044 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r podName:a7c21d5a-7ed5-4309-8f19-30b82abbc850 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:12.963027374 +0000 UTC m=+66.199068656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vpv6r" (UniqueName: "kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r") pod "network-check-target-k5zgz" (UID: "a7c21d5a-7ed5-4309-8f19-30b82abbc850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 04:39:41.173102 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:41.173018 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:41.173294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:41.173018 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:41.173294 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:41.173152 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pcswx" podUID="aacb3060-88cb-44f2-9e1d-5635b5ae4506" Jul 23 04:39:41.173294 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:41.173233 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k5zgz" podUID="a7c21d5a-7ed5-4309-8f19-30b82abbc850" Jul 23 04:39:41.173294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:41.173022 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:41.173479 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:41.173325 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wllts" podUID="4cb7174a-e1f8-4b2b-8c2e-70a38284943c" Jul 23 04:39:43.152361 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.152325 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-3.ec2.internal" event="NodeReady" Jul 23 04:39:43.152851 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.152506 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 04:39:43.172724 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.172690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:39:43.172910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.172690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:39:43.173012 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.172973 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:39:43.175102 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175076 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 04:39:43.175239 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175126 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m89hb\"" Jul 23 04:39:43.175239 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175190 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2njx\"" Jul 23 04:39:43.175239 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175127 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 04:39:43.175488 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175472 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 04:39:43.175576 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.175557 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 04:39:43.190370 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.190344 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:39:43.194242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.194222 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.197221 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.197202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ghfkp\"" Jul 23 04:39:43.197430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.197411 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 04:39:43.197550 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.197531 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 04:39:43.197689 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.197670 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 04:39:43.203927 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.203896 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 04:39:43.204798 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.204776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:39:43.210723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.210677 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-frvlm"] Jul 23 04:39:43.214363 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.214339 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tzm7s"] Jul 23 04:39:43.214489 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.214462 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.216817 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.216790 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k9hcj\"" Jul 23 04:39:43.216949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.216825 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 04:39:43.216949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.216910 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 04:39:43.217064 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.216968 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 04:39:43.217833 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.217814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.219591 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.219573 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 04:39:43.219681 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.219597 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 04:39:43.219737 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.219700 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8x9dj\"" Jul 23 04:39:43.221968 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.221931 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-frvlm"] Jul 23 04:39:43.225369 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.225344 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tzm7s"] Jul 23 04:39:43.363334 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.363295 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:43.381337 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.381538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w68n\" (UniqueName: \"kubernetes.io/projected/0e0a230a-ea11-4882-b2bf-80d81758f55b-kube-api-access-2w68n\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.381538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381535 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8524fdca-ef3f-4916-b6ac-35196de3322d-cert\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.381694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381572 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381636 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7mh\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e0a230a-ea11-4882-b2bf-80d81758f55b-tmp-dir\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.381853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6d4m\" (UniqueName: \"kubernetes.io/projected/8524fdca-ef3f-4916-b6ac-35196de3322d-kube-api-access-b6d4m\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.381853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381756 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0a230a-ea11-4882-b2bf-80d81758f55b-config-volume\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.381853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381800 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381841 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.381986 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.381899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.446022 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.445931 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:43.483178 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483178 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483196 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8524fdca-ef3f-4916-b6ac-35196de3322d-cert\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7mh\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.483309 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483326 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e0a230a-ea11-4882-b2bf-80d81758f55b-tmp-dir\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.483454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6d4m\" (UniqueName: \"kubernetes.io/projected/8524fdca-ef3f-4916-b6ac-35196de3322d-kube-api-access-b6d4m\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.483762 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.483331 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:43.483762 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.483601 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:39:43.983577876 +0000 UTC m=+37.219619115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:43.483762 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483696 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e0a230a-ea11-4882-b2bf-80d81758f55b-tmp-dir\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.483762 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0a230a-ea11-4882-b2bf-80d81758f55b-config-volume\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.483932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483809 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483891 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.483932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.484165 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483947 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w68n\" (UniqueName: \"kubernetes.io/projected/0e0a230a-ea11-4882-b2bf-80d81758f55b-kube-api-access-2w68n\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.484165 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.483985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.484276 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.484256 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:43.484335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.484323 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.484387 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.484334 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:39:43.984313307 +0000 UTC m=+37.220354542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:43.484387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.484337 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0a230a-ea11-4882-b2bf-80d81758f55b-config-volume\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.485329 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.485301 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.488226 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.488196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.488360 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.488200 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.488360 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.488278 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8524fdca-ef3f-4916-b6ac-35196de3322d-cert\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.492269 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.492240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6d4m\" (UniqueName: \"kubernetes.io/projected/8524fdca-ef3f-4916-b6ac-35196de3322d-kube-api-access-b6d4m\") pod \"ingress-canary-frvlm\" (UID: \"8524fdca-ef3f-4916-b6ac-35196de3322d\") " pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.493544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.493519 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w68n\" (UniqueName: \"kubernetes.io/projected/0e0a230a-ea11-4882-b2bf-80d81758f55b-kube-api-access-2w68n\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.494384 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.494341 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.494924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.494903 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7mh\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.526041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.526006 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-frvlm" Jul 23 04:39:43.986454 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.986418 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:43.986720 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:43.986551 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:43.986720 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.986640 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:43.986720 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.986661 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:43.986720 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.986681 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:43.986884 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.986728 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:39:44.986709761 +0000 UTC m=+38.222751016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:43.986884 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:43.986746 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:39:44.986737447 +0000 UTC m=+38.222778681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:44.414032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.413838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:44.505373 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.505316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:44.607937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.607900 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:44.868127 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.868101 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-frvlm"] Jul 23 04:39:44.871380 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:39:44.871352 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8524fdca_ef3f_4916_b6ac_35196de3322d.slice/crio-b91a2f8cefeb848a258a0e04a00b2ed1f34c7a946029702f99a0a988687ff8e5 WatchSource:0}: Error finding container b91a2f8cefeb848a258a0e04a00b2ed1f34c7a946029702f99a0a988687ff8e5: Status 404 returned error can't find the container with id b91a2f8cefeb848a258a0e04a00b2ed1f34c7a946029702f99a0a988687ff8e5 Jul 23 04:39:44.996061 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.996028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:44.996061 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:44.996069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:44.996265 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:44.996181 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:44.996265 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:44.996187 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:44.996265 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:44.996253 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:39:46.996238057 +0000 UTC m=+40.232279292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:44.996381 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:44.996192 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:44.996381 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:44.996314 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:39:46.996302784 +0000 UTC m=+40.232344019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:45.390937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:45.390885 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-frvlm" event={"ID":"8524fdca-ef3f-4916-b6ac-35196de3322d","Type":"ContainerStarted","Data":"b91a2f8cefeb848a258a0e04a00b2ed1f34c7a946029702f99a0a988687ff8e5"} Jul 23 04:39:45.393649 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:45.393599 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="7105a8f146001225fc4561636a0804f2286552e8c544b61dfc2bcc896afbdf65" exitCode=0 Jul 23 04:39:45.393923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:45.393661 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"7105a8f146001225fc4561636a0804f2286552e8c544b61dfc2bcc896afbdf65"} Jul 23 04:39:45.471081 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:45.471052 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:45.593318 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:45.593277 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:46.400138 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:46.400104 2570 generic.go:356] "Generic (PLEG): container finished" podID="6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77" containerID="19df15f706ae2320d8fb84a9744458746c3e5ac2c6ac7ea96485ede72afc914c" exitCode=0 Jul 23 04:39:46.400333 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:46.400172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerDied","Data":"19df15f706ae2320d8fb84a9744458746c3e5ac2c6ac7ea96485ede72afc914c"} Jul 23 04:39:47.011898 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.011608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.011928 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:47.011774 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:47.012035 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:39:51.012010928 +0000 UTC m=+44.248052174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:47.012098 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:47.012113 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:47.012362 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:47.012170 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:39:51.012153988 +0000 UTC m=+44.248195246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:47.408823 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.408787 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25tw7" event={"ID":"6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77","Type":"ContainerStarted","Data":"0a4690f53d5f3f7a240a16d9630ef991b3e64db83c693815b21afdb4b32357dd"} Jul 23 04:39:47.434714 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.434676 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:47.444731 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.444062 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-25tw7" podStartSLOduration=8.874110838 podStartE2EDuration="39.444040021s" totalImagesPullingTime="30.569929183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:47.441557193 +0000 UTC m=+40.677598452" watchObservedRunningTime="2026-07-23 04:39:47.444040021 +0000 UTC m=+40.680081279" Jul 23 04:39:47.510113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.510081 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:47.611893 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.611850 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:47.710036 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.709948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:47.787794 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:47.787763 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:48.413134 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:48.413093 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-frvlm" event={"ID":"8524fdca-ef3f-4916-b6ac-35196de3322d","Type":"ContainerStarted","Data":"5eebe879e4b867be49d2869b1a30f3772eb64049a69712033d7d1113e0e25a96"} Jul 23 04:39:48.431846 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:48.431790 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-frvlm" podStartSLOduration=2.230987157 podStartE2EDuration="5.43177324s" totalImagesPullingTime="3.200786083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:39:48.430736917 +0000 UTC m=+41.666778174" watchObservedRunningTime="2026-07-23 04:39:48.43177324 +0000 UTC m=+41.667814497" Jul 23 04:39:48.490058 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:48.490026 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:48.883065 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:48.883036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:48.953315 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:48.953280 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:50.436036 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:50.436006 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:51.045032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:51.044984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:51.045215 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:51.045076 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:51.045215 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:51.045142 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:51.045215 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:51.045164 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:51.045215 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:51.045167 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:51.045339 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:51.045219 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:39:59.045205026 +0000 UTC m=+52.281246261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:51.045339 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:51.045233 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:39:59.045227088 +0000 UTC m=+52.281268322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:57.121549 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:57.121514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:57.222285 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:57.222256 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:57.324216 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:57.324185 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:59.109583 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:59.109534 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:39:59.109583 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:59.109589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:39:59.110090 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:59.109718 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 04:39:59.110090 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:59.109778 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls podName:0e0a230a-ea11-4882-b2bf-80d81758f55b nodeName:}" failed. No retries permitted until 2026-07-23 04:40:15.109762606 +0000 UTC m=+68.345803841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls") pod "dns-default-tzm7s" (UID: "0e0a230a-ea11-4882-b2bf-80d81758f55b") : secret "dns-default-metrics-tls" not found Jul 23 04:39:59.110090 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:59.109723 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:39:59.110090 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:59.109802 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:39:59.110090 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:39:59.109875 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:40:15.109861234 +0000 UTC m=+68.345902469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:39:59.729392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:59.729361 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:39:59.829019 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:39:59.828982 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:00.510936 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:00.510899 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:00.611124 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:00.611093 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:01.395956 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.395910 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs"] Jul 23 04:40:01.418029 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.417998 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9"] Jul 23 04:40:01.418196 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.418129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" Jul 23 04:40:01.420416 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.420394 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bq6nc\"" Jul 23 04:40:01.442169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.442136 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tdnmm"] Jul 23 04:40:01.442349 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.442259 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.444818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.444781 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 04:40:01.444818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.444793 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 04:40:01.445056 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.444793 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pc9qg\"" Jul 23 04:40:01.445056 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.444928 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:40:01.458142 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.458104 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs"] Jul 23 04:40:01.458142 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.458149 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9"] Jul 23 04:40:01.458387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.458175 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tdnmm"] Jul 23 04:40:01.458387 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.458246 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.461288 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.461255 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 04:40:01.461455 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.461347 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 04:40:01.461455 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.461401 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:40:01.461594 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.461407 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w6s56\"" Jul 23 04:40:01.461594 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.461585 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 04:40:01.467579 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.467549 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 04:40:01.529686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mgwh\" (UniqueName: \"kubernetes.io/projected/579e9a2a-d604-4374-b18a-e33bbf6ad209-kube-api-access-7mgwh\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eab6cd5-9527-48f1-8c43-fb823a201a06-serving-cert\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-config\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529922 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxfts\" (UniqueName: \"kubernetes.io/projected/1c104f48-c00e-44a0-b2a8-8e7c11b48d00-kube-api-access-zxfts\") pod \"network-check-source-7bc5b6bf85-rffhs\" (UID: \"1c104f48-c00e-44a0-b2a8-8e7c11b48d00\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-trusted-ca\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.530145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.529999 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb444\" (UniqueName: \"kubernetes.io/projected/4eab6cd5-9527-48f1-8c43-fb823a201a06-kube-api-access-fb444\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.616675 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.616641 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:01.630681 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630639 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mgwh\" (UniqueName: \"kubernetes.io/projected/579e9a2a-d604-4374-b18a-e33bbf6ad209-kube-api-access-7mgwh\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630693 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eab6cd5-9527-48f1-8c43-fb823a201a06-serving-cert\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-config\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630776 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxfts\" (UniqueName: \"kubernetes.io/projected/1c104f48-c00e-44a0-b2a8-8e7c11b48d00-kube-api-access-zxfts\") pod \"network-check-source-7bc5b6bf85-rffhs\" (UID: \"1c104f48-c00e-44a0-b2a8-8e7c11b48d00\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630800 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-trusted-ca\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.630871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.630859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb444\" (UniqueName: \"kubernetes.io/projected/4eab6cd5-9527-48f1-8c43-fb823a201a06-kube-api-access-fb444\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.631303 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:01.630870 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 04:40:01.631303 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:01.630944 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls podName:579e9a2a-d604-4374-b18a-e33bbf6ad209 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:02.130923671 +0000 UTC m=+55.366964928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pm2q9" (UID: "579e9a2a-d604-4374-b18a-e33bbf6ad209") : secret "samples-operator-tls" not found Jul 23 04:40:01.631531 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.631507 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-config\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.631740 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.631718 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4eab6cd5-9527-48f1-8c43-fb823a201a06-trusted-ca\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.634542 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.634513 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4eab6cd5-9527-48f1-8c43-fb823a201a06-serving-cert\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.640585 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.640550 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mgwh\" (UniqueName: \"kubernetes.io/projected/579e9a2a-d604-4374-b18a-e33bbf6ad209-kube-api-access-7mgwh\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:01.640755 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.640606 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb444\" (UniqueName: \"kubernetes.io/projected/4eab6cd5-9527-48f1-8c43-fb823a201a06-kube-api-access-fb444\") pod \"console-operator-565b7b569d-tdnmm\" (UID: \"4eab6cd5-9527-48f1-8c43-fb823a201a06\") " pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.640885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.640868 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxfts\" (UniqueName: \"kubernetes.io/projected/1c104f48-c00e-44a0-b2a8-8e7c11b48d00-kube-api-access-zxfts\") pod \"network-check-source-7bc5b6bf85-rffhs\" (UID: \"1c104f48-c00e-44a0-b2a8-8e7c11b48d00\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" Jul 23 04:40:01.697457 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.697363 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:01.726881 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.726845 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" Jul 23 04:40:01.763014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.762977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:01.767919 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.767885 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:01.873708 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.873320 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:01.911738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.911701 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs"] Jul 23 04:40:01.915491 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:01.915449 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c104f48_c00e_44a0_b2a8_8e7c11b48d00.slice/crio-d52955a22c628ab850287695d13f9ceacf18245eb84d99ecdc00341087aa951b WatchSource:0}: Error finding container d52955a22c628ab850287695d13f9ceacf18245eb84d99ecdc00341087aa951b: Status 404 returned error can't find the container with id d52955a22c628ab850287695d13f9ceacf18245eb84d99ecdc00341087aa951b Jul 23 04:40:01.953772 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:01.953680 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tdnmm"] Jul 23 04:40:01.956820 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:01.956794 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eab6cd5_9527_48f1_8c43_fb823a201a06.slice/crio-92bd5eda2973c23ef0bad9bdd5f26fae36ec435e11a54842903cc2b0d9d235f6 WatchSource:0}: Error finding container 92bd5eda2973c23ef0bad9bdd5f26fae36ec435e11a54842903cc2b0d9d235f6: Status 404 returned error can't find the container with id 92bd5eda2973c23ef0bad9bdd5f26fae36ec435e11a54842903cc2b0d9d235f6 Jul 23 04:40:02.136505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:02.136464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:02.136748 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:02.136687 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 04:40:02.136813 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:02.136774 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls podName:579e9a2a-d604-4374-b18a-e33bbf6ad209 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:03.136753092 +0000 UTC m=+56.372794351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pm2q9" (UID: "579e9a2a-d604-4374-b18a-e33bbf6ad209") : secret "samples-operator-tls" not found Jul 23 04:40:02.447193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:02.447161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" event={"ID":"1c104f48-c00e-44a0-b2a8-8e7c11b48d00","Type":"ContainerStarted","Data":"d52955a22c628ab850287695d13f9ceacf18245eb84d99ecdc00341087aa951b"} Jul 23 04:40:02.448242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:02.448216 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" event={"ID":"4eab6cd5-9527-48f1-8c43-fb823a201a06","Type":"ContainerStarted","Data":"92bd5eda2973c23ef0bad9bdd5f26fae36ec435e11a54842903cc2b0d9d235f6"} Jul 23 04:40:03.145138 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:03.144999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:03.145138 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:03.145128 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 04:40:03.145662 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:03.145202 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls podName:579e9a2a-d604-4374-b18a-e33bbf6ad209 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:05.145183834 +0000 UTC m=+58.381225068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pm2q9" (UID: "579e9a2a-d604-4374-b18a-e33bbf6ad209") : secret "samples-operator-tls" not found Jul 23 04:40:05.047820 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.047784 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:05.147932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.147886 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:05.166105 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.166060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:05.166302 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:05.166248 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 04:40:05.166358 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:05.166326 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls podName:579e9a2a-d604-4374-b18a-e33bbf6ad209 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:09.166308905 +0000 UTC m=+62.402350139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pm2q9" (UID: "579e9a2a-d604-4374-b18a-e33bbf6ad209") : secret "samples-operator-tls" not found Jul 23 04:40:05.457008 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.456977 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/0.log" Jul 23 04:40:05.457200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.457022 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eab6cd5-9527-48f1-8c43-fb823a201a06" containerID="55e3395876eb2a2eb9a833648afbd30131cefa8c5581bcb2ea032cff1ec153e6" exitCode=255 Jul 23 04:40:05.457200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.457061 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" event={"ID":"4eab6cd5-9527-48f1-8c43-fb823a201a06","Type":"ContainerDied","Data":"55e3395876eb2a2eb9a833648afbd30131cefa8c5581bcb2ea032cff1ec153e6"} Jul 23 04:40:05.457327 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.457312 2570 scope.go:117] "RemoveContainer" containerID="55e3395876eb2a2eb9a833648afbd30131cefa8c5581bcb2ea032cff1ec153e6" Jul 23 04:40:05.458802 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.458778 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" event={"ID":"1c104f48-c00e-44a0-b2a8-8e7c11b48d00","Type":"ContainerStarted","Data":"b586b5b420b0621bd22bb4d8ef24c5726edddc56291ae087a43a2a95630c73a2"} Jul 23 04:40:05.498275 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.498213 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-rffhs" podStartSLOduration=1.169585668 podStartE2EDuration="4.498188206s" totalImagesPullingTime="3.328602538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:05.496934549 +0000 UTC m=+58.732975807" watchObservedRunningTime="2026-07-23 04:40:05.498188206 +0000 UTC m=+58.734229467" Jul 23 04:40:05.573983 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.573949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:05.674100 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:05.674066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:06.463094 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463067 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:40:06.463541 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/0.log" Jul 23 04:40:06.463599 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463549 2570 generic.go:356] "Generic (PLEG): container finished" podID="4eab6cd5-9527-48f1-8c43-fb823a201a06" containerID="403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e" exitCode=255 Jul 23 04:40:06.463686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" event={"ID":"4eab6cd5-9527-48f1-8c43-fb823a201a06","Type":"ContainerDied","Data":"403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e"} Jul 23 04:40:06.463738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463710 2570 scope.go:117] "RemoveContainer" containerID="55e3395876eb2a2eb9a833648afbd30131cefa8c5581bcb2ea032cff1ec153e6" Jul 23 04:40:06.463899 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.463879 2570 scope.go:117] "RemoveContainer" containerID="403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e" Jul 23 04:40:06.464095 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:06.464070 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tdnmm_openshift-console-operator(4eab6cd5-9527-48f1-8c43-fb823a201a06)\"" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" podUID="4eab6cd5-9527-48f1-8c43-fb823a201a06" Jul 23 04:40:06.537281 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.537239 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kpc2j"] Jul 23 04:40:06.541520 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.541492 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.543821 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.543795 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 04:40:06.543979 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.543923 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4ss2x\"" Jul 23 04:40:06.543979 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.543959 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 04:40:06.544820 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.544803 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 04:40:06.558215 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.558181 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 04:40:06.558591 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.558573 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpc2j"] Jul 23 04:40:06.631167 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.631126 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:06.681258 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.681092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d317758-96e2-4668-991d-c1a1fff86550-crio-socket\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.681539 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.681283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.681539 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.681417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d317758-96e2-4668-991d-c1a1fff86550-data-volume\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.681539 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.681454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.681539 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.681481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fggd\" (UniqueName: \"kubernetes.io/projected/4d317758-96e2-4668-991d-c1a1fff86550-kube-api-access-6fggd\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.714184 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.714092 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:06.782541 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d317758-96e2-4668-991d-c1a1fff86550-crio-socket\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782649 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d317758-96e2-4668-991d-c1a1fff86550-crio-socket\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d317758-96e2-4668-991d-c1a1fff86550-data-volume\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782706 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782728 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fggd\" (UniqueName: \"kubernetes.io/projected/4d317758-96e2-4668-991d-c1a1fff86550-kube-api-access-6fggd\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.782918 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:06.782758 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 04:40:06.782918 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:06.782808 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 04:40:06.782918 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:06.782828 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:07.282808501 +0000 UTC m=+60.518849754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : secret "insights-runtime-extractor-tls" not found Jul 23 04:40:06.782918 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:06.782881 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:07.28286273 +0000 UTC m=+60.518903977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : configmap "kube-rbac-proxy" not found Jul 23 04:40:06.783089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.782976 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d317758-96e2-4668-991d-c1a1fff86550-data-volume\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:06.795175 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:06.795148 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fggd\" (UniqueName: \"kubernetes.io/projected/4d317758-96e2-4668-991d-c1a1fff86550-kube-api-access-6fggd\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:07.135867 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.135834 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.242161 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.242125 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.287309 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.287268 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:07.287476 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.287342 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:07.287476 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:07.287434 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 04:40:07.287476 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:07.287449 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 04:40:07.287578 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:07.287486 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:08.287472013 +0000 UTC m=+61.523513260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : configmap "kube-rbac-proxy" not found Jul 23 04:40:07.287578 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:07.287505 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:08.28749148 +0000 UTC m=+61.523532716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : secret "insights-runtime-extractor-tls" not found Jul 23 04:40:07.317928 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.317893 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.382062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.382023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.468020 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.467938 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:40:07.468392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.468286 2570 scope.go:117] "RemoveContainer" containerID="403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e" Jul 23 04:40:07.468444 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:07.468424 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tdnmm_openshift-console-operator(4eab6cd5-9527-48f1-8c43-fb823a201a06)\"" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" podUID="4eab6cd5-9527-48f1-8c43-fb823a201a06" Jul 23 04:40:07.482961 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.482913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.584875 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.584838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.853590 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.853476 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:07.952593 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:07.952556 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:08.297286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:08.297244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:08.297472 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:08.297323 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:08.297472 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:08.297389 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 04:40:08.297472 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:08.297394 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 04:40:08.297472 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:08.297451 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:10.297435995 +0000 UTC m=+63.533477229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : secret "insights-runtime-extractor-tls" not found Jul 23 04:40:08.297472 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:08.297467 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:10.297460224 +0000 UTC m=+63.533501459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : configmap "kube-rbac-proxy" not found Jul 23 04:40:08.747970 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:08.747943 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9lfrx_054885b4-fca9-4be3-911e-ac40fe21741c/dns-node-resolver/0.log" Jul 23 04:40:09.206297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:09.206251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:09.206459 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:09.206414 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 04:40:09.206523 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:09.206483 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls podName:579e9a2a-d604-4374-b18a-e33bbf6ad209 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:17.206464764 +0000 UTC m=+70.442506000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-pm2q9" (UID: "579e9a2a-d604-4374-b18a-e33bbf6ad209") : secret "samples-operator-tls" not found Jul 23 04:40:09.389205 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:09.389176 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-45j69" Jul 23 04:40:09.559135 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:09.559030 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:09.658949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:09.658913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:09.746979 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:09.746957 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xbft6_db588ac8-e5ff-4986-aa27-0649ffabbd0a/node-ca/0.log" Jul 23 04:40:10.147308 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:10.147269 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-frvlm_8524fdca-ef3f-4916-b6ac-35196de3322d/serve-healthcheck-canary/0.log" Jul 23 04:40:10.244682 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:10.244645 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:10.315712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:10.315673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:10.315901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:10.315765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:10.315901 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:10.315856 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 04:40:10.315901 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:10.315880 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 04:40:10.316060 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:10.315956 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:14.315939686 +0000 UTC m=+67.551980934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : configmap "kube-rbac-proxy" not found Jul 23 04:40:10.316060 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:10.315970 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:14.315963612 +0000 UTC m=+67.552004846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : secret "insights-runtime-extractor-tls" not found Jul 23 04:40:11.657024 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.656993 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:11.768702 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.768652 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:11.768702 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.768720 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:11.769060 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.769048 2570 scope.go:117] "RemoveContainer" containerID="403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e" Jul 23 04:40:11.769226 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:11.769208 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tdnmm_openshift-console-operator(4eab6cd5-9527-48f1-8c43-fb823a201a06)\"" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" podUID="4eab6cd5-9527-48f1-8c43-fb823a201a06" Jul 23 04:40:11.898229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.898198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:11.995154 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:11.995051 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:12.093950 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.093907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:12.195923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.195888 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:12.299502 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.299402 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:12.428565 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.428536 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:12.938228 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.938174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:40:12.940460 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:12.940438 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 04:40:12.949437 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:12.949405 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 04:40:12.949573 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:12.949488 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs podName:aacb3060-88cb-44f2-9e1d-5635b5ae4506 nodeName:}" failed. No retries permitted until 2026-07-23 04:41:16.949466563 +0000 UTC m=+130.185507812 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs") pod "network-metrics-daemon-pcswx" (UID: "aacb3060-88cb-44f2-9e1d-5635b5ae4506") : secret "metrics-daemon-secret" not found Jul 23 04:40:13.039402 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.039359 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:40:13.039584 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.039428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:40:13.042004 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.041979 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 04:40:13.042129 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.042101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpv6r\" (UniqueName: \"kubernetes.io/projected/a7c21d5a-7ed5-4309-8f19-30b82abbc850-kube-api-access-vpv6r\") pod \"network-check-target-k5zgz\" (UID: \"a7c21d5a-7ed5-4309-8f19-30b82abbc850\") " pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:40:13.052311 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.052285 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cb7174a-e1f8-4b2b-8c2e-70a38284943c-original-pull-secret\") pod \"global-pull-secret-syncer-wllts\" (UID: \"4cb7174a-e1f8-4b2b-8c2e-70a38284943c\") " pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:40:13.187229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.187192 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m89hb\"" Jul 23 04:40:13.195289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.195226 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:40:13.196471 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.196453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wllts" Jul 23 04:40:13.332046 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.332013 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k5zgz"] Jul 23 04:40:13.334953 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:13.334919 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c21d5a_7ed5_4309_8f19_30b82abbc850.slice/crio-07025b4dc51e563d86a4c6d6da4e53032101e3210cfadf0bc7ae9716e1c68340 WatchSource:0}: Error finding container 07025b4dc51e563d86a4c6d6da4e53032101e3210cfadf0bc7ae9716e1c68340: Status 404 returned error can't find the container with id 07025b4dc51e563d86a4c6d6da4e53032101e3210cfadf0bc7ae9716e1c68340 Jul 23 04:40:13.340546 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.340465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:13.345900 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.345877 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wllts"] Jul 23 04:40:13.349061 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:13.349034 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb7174a_e1f8_4b2b_8c2e_70a38284943c.slice/crio-b24565327b6a98553af755ca464018234e7b080719eb2f89553925bd832b1e96 WatchSource:0}: Error finding container b24565327b6a98553af755ca464018234e7b080719eb2f89553925bd832b1e96: Status 404 returned error can't find the container with id b24565327b6a98553af755ca464018234e7b080719eb2f89553925bd832b1e96 Jul 23 04:40:13.484217 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.484122 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wllts" event={"ID":"4cb7174a-e1f8-4b2b-8c2e-70a38284943c","Type":"ContainerStarted","Data":"b24565327b6a98553af755ca464018234e7b080719eb2f89553925bd832b1e96"} Jul 23 04:40:13.485611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.485588 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k5zgz" event={"ID":"a7c21d5a-7ed5-4309-8f19-30b82abbc850","Type":"ContainerStarted","Data":"571403fe245fa0c60822ee4d352cac6a48a8371a1214bb43af7ccb300ec92526"} Jul 23 04:40:13.485733 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.485651 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k5zgz" event={"ID":"a7c21d5a-7ed5-4309-8f19-30b82abbc850","Type":"ContainerStarted","Data":"07025b4dc51e563d86a4c6d6da4e53032101e3210cfadf0bc7ae9716e1c68340"} Jul 23 04:40:13.485733 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.485719 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:40:13.502220 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.502169 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k5zgz" podStartSLOduration=65.502152769 podStartE2EDuration="1m5.502152769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:13.50180394 +0000 UTC m=+66.737845197" watchObservedRunningTime="2026-07-23 04:40:13.502152769 +0000 UTC m=+66.738194004" Jul 23 04:40:13.555145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.555113 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:13.654197 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.654162 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:13.952304 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:13.952273 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:14.151076 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:14.151041 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:14.351704 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:14.351599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:14.351857 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:14.351722 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 04:40:14.351857 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:14.351787 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:22.351769129 +0000 UTC m=+75.587810383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : configmap "kube-rbac-proxy" not found Jul 23 04:40:14.351857 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:14.351838 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 04:40:14.351993 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:14.351877 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls podName:4d317758-96e2-4668-991d-c1a1fff86550 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:22.351865297 +0000 UTC m=+75.587906546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kpc2j" (UID: "4d317758-96e2-4668-991d-c1a1fff86550") : secret "insights-runtime-extractor-tls" not found Jul 23 04:40:14.351993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:14.351721 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:14.753057 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:14.753015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:15.147927 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.147882 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:15.158985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.158946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:40:15.159162 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.158999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:40:15.159162 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:15.159141 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 04:40:15.159162 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:15.159155 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d4fc9bff4-s42tf: secret "image-registry-tls" not found Jul 23 04:40:15.159317 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:15.159207 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls podName:82f5a2b0-728d-4020-8a6e-97187c32318a nodeName:}" failed. No retries permitted until 2026-07-23 04:40:47.159192159 +0000 UTC m=+100.395233395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls") pod "image-registry-d4fc9bff4-s42tf" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a") : secret "image-registry-tls" not found Jul 23 04:40:15.161881 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.161827 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e0a230a-ea11-4882-b2bf-80d81758f55b-metrics-tls\") pod \"dns-default-tzm7s\" (UID: \"0e0a230a-ea11-4882-b2bf-80d81758f55b\") " pod="openshift-dns/dns-default-tzm7s" Jul 23 04:40:15.341469 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.341439 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8x9dj\"" Jul 23 04:40:15.343555 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.343524 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tzm7s" Jul 23 04:40:15.383604 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.383566 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:15.516453 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.516409 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tzm7s"] Jul 23 04:40:15.516843 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.516816 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:15.519428 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:15.519399 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0a230a_ea11_4882_b2bf_80d81758f55b.slice/crio-0c89d9547619c26a75568c8261a79bb9c49d344af9c83338d29d8aab5d6cfe06 WatchSource:0}: Error finding container 0c89d9547619c26a75568c8261a79bb9c49d344af9c83338d29d8aab5d6cfe06: Status 404 returned error can't find the container with id 0c89d9547619c26a75568c8261a79bb9c49d344af9c83338d29d8aab5d6cfe06 Jul 23 04:40:15.781872 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.781792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:15.897196 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:15.897164 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:16.495922 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:16.495883 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzm7s" event={"ID":"0e0a230a-ea11-4882-b2bf-80d81758f55b","Type":"ContainerStarted","Data":"0c89d9547619c26a75568c8261a79bb9c49d344af9c83338d29d8aab5d6cfe06"} Jul 23 04:40:16.556054 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:16.556019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:16.648139 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:16.648102 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:16.756538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:16.756377 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:16.973968 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:16.973935 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:17.279684 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.279640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:17.282340 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.282311 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/579e9a2a-d604-4374-b18a-e33bbf6ad209-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-pm2q9\" (UID: \"579e9a2a-d604-4374-b18a-e33bbf6ad209\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:17.353904 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.353865 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pc9qg\"" Jul 23 04:40:17.358216 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.358184 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:17.362029 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.361990 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" Jul 23 04:40:17.951557 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:17.951505 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:18.347662 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:18.347527 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:18.661377 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:18.661347 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9"] Jul 23 04:40:18.754728 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:18.754699 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:18.899175 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:18.899128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:18.995003 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:18.994971 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:19.143098 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.143062 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:19.507171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.507127 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wllts" event={"ID":"4cb7174a-e1f8-4b2b-8c2e-70a38284943c","Type":"ContainerStarted","Data":"ccaf5ac0c8b5e1ffb01f9a5dc21f62be0ac5c42a32bb9413d602ea6861835ad9"} Jul 23 04:40:19.508277 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.508255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" event={"ID":"579e9a2a-d604-4374-b18a-e33bbf6ad209","Type":"ContainerStarted","Data":"7ac8d8078e3729b9b0a92f996ce2493062df9eea25b77b1e285e78f03925ab68"} Jul 23 04:40:19.509855 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.509831 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzm7s" event={"ID":"0e0a230a-ea11-4882-b2bf-80d81758f55b","Type":"ContainerStarted","Data":"8412396dc124a3f5ea38baace56b310ca45230c0867e0142d05e3c6ac0bd04ac"} Jul 23 04:40:19.509934 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.509879 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tzm7s" event={"ID":"0e0a230a-ea11-4882-b2bf-80d81758f55b","Type":"ContainerStarted","Data":"b81fc953b033cf84cf740c0baf116a21aa3672129e038d4d272f27ae942e5834"} Jul 23 04:40:19.509934 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.509911 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tzm7s" Jul 23 04:40:19.524923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.524867 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wllts" podStartSLOduration=66.357981572 podStartE2EDuration="1m11.524851635s" totalImagesPullingTime="5.166870063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:19.523986945 +0000 UTC m=+72.760028202" watchObservedRunningTime="2026-07-23 04:40:19.524851635 +0000 UTC m=+72.760892892" Jul 23 04:40:19.541171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.541118 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tzm7s" podStartSLOduration=33.541325706 podStartE2EDuration="36.541102728s" totalImagesPullingTime="2.999777022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:19.540526931 +0000 UTC m=+72.776568189" watchObservedRunningTime="2026-07-23 04:40:19.541102728 +0000 UTC m=+72.777143993" Jul 23 04:40:19.734786 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:19.734755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:20.154132 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:20.154097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:20.343851 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:20.343818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:20.756554 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:20.756510 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:20.940206 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:20.939889 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:21.346986 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.346891 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:21.522237 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.522194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" event={"ID":"579e9a2a-d604-4374-b18a-e33bbf6ad209","Type":"ContainerStarted","Data":"2b6c29cd8a4c03a1e4af6897495faa891758897b8a00642da33b2b5166b40b80"} Jul 23 04:40:21.522437 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.522284 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" event={"ID":"579e9a2a-d604-4374-b18a-e33bbf6ad209","Type":"ContainerStarted","Data":"74ac66cb5cef9c2183834063d73074318518059e80904b478504ee9274788628"} Jul 23 04:40:21.540488 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.540428 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-pm2q9" podStartSLOduration=18.327225078 podStartE2EDuration="20.540412611s" totalImagesPullingTime="2.213187533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:21.540398896 +0000 UTC m=+74.776440153" watchObservedRunningTime="2026-07-23 04:40:21.540412611 +0000 UTC m=+74.776453867" Jul 23 04:40:21.744048 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.744013 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:21.982147 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:21.982117 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:22.082327 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.082247 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:22.344043 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.343951 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:22.425127 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.425081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:22.425500 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.425164 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:22.425642 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.425603 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d317758-96e2-4668-991d-c1a1fff86550-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:22.427667 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.427647 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d317758-96e2-4668-991d-c1a1fff86550-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpc2j\" (UID: \"4d317758-96e2-4668-991d-c1a1fff86550\") " pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:22.452683 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.452646 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4ss2x\"" Jul 23 04:40:22.460725 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.460699 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpc2j" Jul 23 04:40:22.601646 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:22.601601 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpc2j"] Jul 23 04:40:22.603981 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:22.603953 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d317758_96e2_4668_991d_c1a1fff86550.slice/crio-b5ca2d759ce764af0dc0d35bbc5ab79febca5f0e9da558abf7a5abbaf8a4a9d6 WatchSource:0}: Error finding container b5ca2d759ce764af0dc0d35bbc5ab79febca5f0e9da558abf7a5abbaf8a4a9d6: Status 404 returned error can't find the container with id b5ca2d759ce764af0dc0d35bbc5ab79febca5f0e9da558abf7a5abbaf8a4a9d6 Jul 23 04:40:23.534063 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:23.534018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpc2j" event={"ID":"4d317758-96e2-4668-991d-c1a1fff86550","Type":"ContainerStarted","Data":"b5ca2d759ce764af0dc0d35bbc5ab79febca5f0e9da558abf7a5abbaf8a4a9d6"} Jul 23 04:40:26.172664 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:26.172609 2570 scope.go:117] "RemoveContainer" containerID="403ea690d07b8fe1575b28e5f0790442125a852eb29c247a55476bb183a6b75e" Jul 23 04:40:27.549875 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:27.549850 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:40:28.008905 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.008852 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.108942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.108906 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.168120 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.168086 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.307065 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.306984 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.503300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.503267 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.556465 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.556427 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpc2j" event={"ID":"4d317758-96e2-4668-991d-c1a1fff86550","Type":"ContainerStarted","Data":"b291a4b5fe7787057311aea4d8719222222a6167f71a1cccfc6303a265a62946"} Jul 23 04:40:28.558781 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.558716 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:40:28.558904 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.558789 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" event={"ID":"4eab6cd5-9527-48f1-8c43-fb823a201a06","Type":"ContainerStarted","Data":"b350693c2445b8221596ea900d27a7a10e35d43f8fb87088155989056866c461"} Jul 23 04:40:28.559547 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.559521 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:28.565351 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.565325 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" Jul 23 04:40:28.579890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.579840 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-tdnmm" podStartSLOduration=24.338055489 podStartE2EDuration="27.579824211s" totalImagesPullingTime="3.241768722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:28.579136414 +0000 UTC m=+81.815177671" watchObservedRunningTime="2026-07-23 04:40:28.579824211 +0000 UTC m=+81.815865468" Jul 23 04:40:28.591097 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.591060 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.695272 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.695222 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.893242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.893199 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:28.962924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:28.962893 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:29.097350 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.097321 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:29.283702 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.283584 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:29.350474 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.350437 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:29.516405 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.516379 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tzm7s" Jul 23 04:40:29.697643 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.697587 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:29.891207 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:29.891170 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:30.238101 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:30.238066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:30.338597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:30.338555 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:30.438993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:30.438963 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:31.570890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:31.570809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpc2j" event={"ID":"4d317758-96e2-4668-991d-c1a1fff86550","Type":"ContainerStarted","Data":"0d66857a28882be5486adae26ddd79167762821d7218022cb007be963b029c94"} Jul 23 04:40:32.618183 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.618147 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn"] Jul 23 04:40:32.621575 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.621497 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b"] Jul 23 04:40:32.621881 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.621857 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.624384 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.624159 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 04:40:32.625375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.625112 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 04:40:32.625375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.625141 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 04:40:32.625375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.625115 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 23 04:40:32.630325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.630097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.633133 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.633109 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 04:40:32.633248 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.633109 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mkprv\"" Jul 23 04:40:32.633610 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.633587 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn"] Jul 23 04:40:32.636813 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.636788 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b"] Jul 23 04:40:32.713818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.713778 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstcp\" (UniqueName: \"kubernetes.io/projected/b25b824e-29ab-432a-806c-23c335ac74d4-kube-api-access-pstcp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.713818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.713825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25b824e-29ab-432a-806c-23c335ac74d4-tmp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.714061 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.713923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c35ebd20-28e9-4dc2-9db5-96876757abbe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.714061 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.713961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szbn8\" (UniqueName: \"kubernetes.io/projected/c35ebd20-28e9-4dc2-9db5-96876757abbe-kube-api-access-szbn8\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.714201 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.714087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b25b824e-29ab-432a-806c-23c335ac74d4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.730772 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.730740 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:32.815152 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b25b824e-29ab-432a-806c-23c335ac74d4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.815341 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstcp\" (UniqueName: \"kubernetes.io/projected/b25b824e-29ab-432a-806c-23c335ac74d4-kube-api-access-pstcp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.815341 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815202 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25b824e-29ab-432a-806c-23c335ac74d4-tmp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.815341 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c35ebd20-28e9-4dc2-9db5-96876757abbe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.815341 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szbn8\" (UniqueName: \"kubernetes.io/projected/c35ebd20-28e9-4dc2-9db5-96876757abbe-kube-api-access-szbn8\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.815733 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.815697 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25b824e-29ab-432a-806c-23c335ac74d4-tmp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.818253 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.818223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c35ebd20-28e9-4dc2-9db5-96876757abbe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.818253 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.818250 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b25b824e-29ab-432a-806c-23c335ac74d4-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.831111 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.831081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstcp\" (UniqueName: \"kubernetes.io/projected/b25b824e-29ab-432a-806c-23c335ac74d4-kube-api-access-pstcp\") pod \"klusterlet-addon-workmgr-5cbf9b6779-7xqmn\" (UID: \"b25b824e-29ab-432a-806c-23c335ac74d4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.831275 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.831216 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szbn8\" (UniqueName: \"kubernetes.io/projected/c35ebd20-28e9-4dc2-9db5-96876757abbe-kube-api-access-szbn8\") pod \"managed-serviceaccount-addon-agent-86d5d6b684-n4c8b\" (UID: \"c35ebd20-28e9-4dc2-9db5-96876757abbe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:32.843902 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.843866 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:32.934824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.934723 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:32.940981 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.940942 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:32.952392 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:32.952363 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" Jul 23 04:40:33.065014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:33.064948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:33.100753 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:33.100718 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn"] Jul 23 04:40:33.114146 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:33.114118 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b"] Jul 23 04:40:33.678901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:33.678869 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:33.745857 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:33.745817 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:34.685954 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:34.685920 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25b824e_29ab_432a_806c_23c335ac74d4.slice/crio-0eb80085bab646cd2b403cbafc6cc92f69c2d38f1df7b34b6149c1e8e161203c WatchSource:0}: Error finding container 0eb80085bab646cd2b403cbafc6cc92f69c2d38f1df7b34b6149c1e8e161203c: Status 404 returned error can't find the container with id 0eb80085bab646cd2b403cbafc6cc92f69c2d38f1df7b34b6149c1e8e161203c Jul 23 04:40:34.686409 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:34.686383 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc35ebd20_28e9_4dc2_9db5_96876757abbe.slice/crio-2bf85f0b792f9f7d2c9d5a0d618c00f266ae19ce01e8742496965005caa9a2e4 WatchSource:0}: Error finding container 2bf85f0b792f9f7d2c9d5a0d618c00f266ae19ce01e8742496965005caa9a2e4: Status 404 returned error can't find the container with id 2bf85f0b792f9f7d2c9d5a0d618c00f266ae19ce01e8742496965005caa9a2e4 Jul 23 04:40:35.587636 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.587582 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" event={"ID":"c35ebd20-28e9-4dc2-9db5-96876757abbe","Type":"ContainerStarted","Data":"2bf85f0b792f9f7d2c9d5a0d618c00f266ae19ce01e8742496965005caa9a2e4"} Jul 23 04:40:35.590129 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.590091 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpc2j" event={"ID":"4d317758-96e2-4668-991d-c1a1fff86550","Type":"ContainerStarted","Data":"e97041e3db6a02f7d5f07f72bfab615cec694379d1c073d1c48d7c4e8f8120a8"} Jul 23 04:40:35.591294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.591258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" event={"ID":"b25b824e-29ab-432a-806c-23c335ac74d4","Type":"ContainerStarted","Data":"0eb80085bab646cd2b403cbafc6cc92f69c2d38f1df7b34b6149c1e8e161203c"} Jul 23 04:40:35.614638 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.614540 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kpc2j" podStartSLOduration=17.597485622 podStartE2EDuration="29.614514664s" totalImagesPullingTime="12.017029042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 04:40:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:35.613547631 +0000 UTC m=+88.849588880" watchObservedRunningTime="2026-07-23 04:40:35.614514664 +0000 UTC m=+88.850555925" Jul 23 04:40:35.672062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.672029 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:35.788350 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:35.788313 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:37.692379 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:37.692295 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:37.777357 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:37.777317 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:38.605244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:38.605194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" event={"ID":"c35ebd20-28e9-4dc2-9db5-96876757abbe","Type":"ContainerStarted","Data":"f268f890b70f16a25753659b9b884f659e235b4fe107cc0ae177bb9c3d9a98ec"} Jul 23 04:40:38.624276 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:38.624216 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86d5d6b684-n4c8b" podStartSLOduration=3.436679758 podStartE2EDuration="6.62419307s" totalImagesPullingTime="3.187513312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:38.623061207 +0000 UTC m=+91.859102464" watchObservedRunningTime="2026-07-23 04:40:38.62419307 +0000 UTC m=+91.860234360" Jul 23 04:40:39.613853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:39.613811 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" event={"ID":"b25b824e-29ab-432a-806c-23c335ac74d4","Type":"ContainerStarted","Data":"3a4bedc1fa31c271a35b702301c7a1944160761eb25968189c7d4a8ce3c04688"} Jul 23 04:40:39.632201 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:39.632137 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" podStartSLOduration=2.972505059 podStartE2EDuration="7.632119233s" totalImagesPullingTime="4.659614174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:39.630987837 +0000 UTC m=+92.867029109" watchObservedRunningTime="2026-07-23 04:40:39.632119233 +0000 UTC m=+92.868160490" Jul 23 04:40:40.617761 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:40.617725 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:40.619515 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:40.619493 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cbf9b6779-7xqmn" Jul 23 04:40:41.526287 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.526233 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:41.620409 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.620375 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:41.722962 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.722932 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:41.830012 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.829900 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:41.881196 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.881163 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl"] Jul 23 04:40:41.884328 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.884307 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:41.886493 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.886472 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 04:40:41.886639 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.886549 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mx9r6\"" Jul 23 04:40:41.892702 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.892678 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl"] Jul 23 04:40:41.912383 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.912347 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:41.994980 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:41.994939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xj7vl\" (UID: \"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:42.096025 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.095924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xj7vl\" (UID: \"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:42.096178 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:42.096082 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 04:40:42.096178 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:40:42.096161 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates podName:7d30f72b-0b36-4d5d-9b9c-ac844761f8d7 nodeName:}" failed. No retries permitted until 2026-07-23 04:40:42.596141518 +0000 UTC m=+95.832182774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-xj7vl" (UID: "7d30f72b-0b36-4d5d-9b9c-ac844761f8d7") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 04:40:42.147285 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.147252 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:42.600596 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.600551 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xj7vl\" (UID: \"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:42.603339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.603300 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d30f72b-0b36-4d5d-9b9c-ac844761f8d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xj7vl\" (UID: \"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:42.793773 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.793729 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:42.927557 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:42.927521 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl"] Jul 23 04:40:42.930841 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:42.930811 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d30f72b_0b36_4d5d_9b9c_ac844761f8d7.slice/crio-c07ab0da30560371c527929151d787e88297729201a49bfc175065054dfcfc37 WatchSource:0}: Error finding container c07ab0da30560371c527929151d787e88297729201a49bfc175065054dfcfc37: Status 404 returned error can't find the container with id c07ab0da30560371c527929151d787e88297729201a49bfc175065054dfcfc37 Jul 23 04:40:43.127964 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:43.127883 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:43.246274 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:43.246239 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:43.628493 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:43.628457 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" event={"ID":"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7","Type":"ContainerStarted","Data":"c07ab0da30560371c527929151d787e88297729201a49bfc175065054dfcfc37"} Jul 23 04:40:44.377971 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.377929 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:44.478810 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.478745 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:44.490757 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.490725 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k5zgz" Jul 23 04:40:44.634020 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.633981 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" event={"ID":"7d30f72b-0b36-4d5d-9b9c-ac844761f8d7","Type":"ContainerStarted","Data":"447ac1dac7676373c0441581e7acfd5d18419ef673425883a2cd69a768ba770c"} Jul 23 04:40:44.634313 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.634295 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:44.638981 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.638959 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" Jul 23 04:40:44.655583 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.655531 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xj7vl" podStartSLOduration=2.299468471 podStartE2EDuration="3.655512188s" totalImagesPullingTime="1.356043717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:44.654291988 +0000 UTC m=+97.890333247" watchObservedRunningTime="2026-07-23 04:40:44.655512188 +0000 UTC m=+97.891553445" Jul 23 04:40:44.907975 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.907877 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:44.976803 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:44.976746 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:45.383057 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:45.382995 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:46.547577 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:46.547519 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:46.632838 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:46.632808 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:47.242146 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.242106 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:40:47.244722 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.244689 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"image-registry-d4fc9bff4-s42tf\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:40:47.408802 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.408769 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ghfkp\"" Jul 23 04:40:47.417693 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.417668 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:40:47.587244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.587212 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:40:47.590442 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:47.590413 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f5a2b0_728d_4020_8a6e_97187c32318a.slice/crio-27de78cf99214a396c6784a04083ecf380c333e4f2bbd9f47549e9ddfe12b026 WatchSource:0}: Error finding container 27de78cf99214a396c6784a04083ecf380c333e4f2bbd9f47549e9ddfe12b026: Status 404 returned error can't find the container with id 27de78cf99214a396c6784a04083ecf380c333e4f2bbd9f47549e9ddfe12b026 Jul 23 04:40:47.648664 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:47.648608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" event={"ID":"82f5a2b0-728d-4020-8a6e-97187c32318a","Type":"ContainerStarted","Data":"27de78cf99214a396c6784a04083ecf380c333e4f2bbd9f47549e9ddfe12b026"} Jul 23 04:40:48.171946 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.171916 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:48.276054 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.276022 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:48.544138 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.544058 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:40:48.576430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.576399 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:40:48.576582 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.576561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.580661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.580603 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 04:40:48.580831 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.580710 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 04:40:48.581143 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.581122 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 04:40:48.581210 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.581159 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 04:40:48.581923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.581906 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 04:40:48.582316 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.582303 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 04:40:48.582365 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.582345 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-25b8x\"" Jul 23 04:40:48.584184 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.584162 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 04:40:48.587880 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.587861 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 04:40:48.653538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85zq\" (UniqueName: \"kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653607 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653731 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.653990 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.653946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" event={"ID":"82f5a2b0-728d-4020-8a6e-97187c32318a","Type":"ContainerStarted","Data":"3692cd7f9a41cde2fcff7a2d942310a0332c2748b2e3f11394ea8c0898cb83d4"} Jul 23 04:40:48.654100 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.654075 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:40:48.680316 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.680262 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" podStartSLOduration=100.68024404 podStartE2EDuration="1m40.68024404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:48.678752222 +0000 UTC m=+101.914793480" watchObservedRunningTime="2026-07-23 04:40:48.68024404 +0000 UTC m=+101.916285297" Jul 23 04:40:48.754418 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754373 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85zq\" (UniqueName: \"kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.754703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754430 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.754703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754492 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.754703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.754703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754597 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.754703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754682 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.755012 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.754739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.755509 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.755476 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.755659 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.755520 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.755736 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.755695 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.755946 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.755928 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.758203 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.758172 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.758296 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.758277 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.764878 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.764850 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85zq\" (UniqueName: \"kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq\") pod \"console-775bd65dc-5pdsf\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:48.887027 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:48.886977 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:49.061070 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:49.061041 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:40:49.063585 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:49.063557 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb74d9f_8d02_47f1_9589_e06f35b59a70.slice/crio-2257985364dd4897f64f1c739483c03e5db72d2c0fd9dbad5b201183b680d3ed WatchSource:0}: Error finding container 2257985364dd4897f64f1c739483c03e5db72d2c0fd9dbad5b201183b680d3ed: Status 404 returned error can't find the container with id 2257985364dd4897f64f1c739483c03e5db72d2c0fd9dbad5b201183b680d3ed Jul 23 04:40:49.658870 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:49.658829 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775bd65dc-5pdsf" event={"ID":"2eb74d9f-8d02-47f1-9589-e06f35b59a70","Type":"ContainerStarted","Data":"2257985364dd4897f64f1c739483c03e5db72d2c0fd9dbad5b201183b680d3ed"} Jul 23 04:40:49.751548 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:49.751507 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:49.864241 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:49.864201 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:52.672665 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:52.672608 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775bd65dc-5pdsf" event={"ID":"2eb74d9f-8d02-47f1-9589-e06f35b59a70","Type":"ContainerStarted","Data":"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd"} Jul 23 04:40:52.693495 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:52.693438 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-775bd65dc-5pdsf" podStartSLOduration=1.806046118 podStartE2EDuration="4.69341757s" totalImagesPullingTime="2.887371452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:40:52.692467809 +0000 UTC m=+105.928509065" watchObservedRunningTime="2026-07-23 04:40:52.69341757 +0000 UTC m=+105.929458829" Jul 23 04:40:53.465766 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:53.465734 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:53.576121 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:53.576082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:53.675513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:53.675477 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:53.778260 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:53.778176 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:54.671285 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:54.671251 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:54.774423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:54.774374 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:54.871664 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:54.871602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:55.625170 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:55.625134 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:40:55.768104 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:55.768066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:55.866850 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:55.866792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:56.812964 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:56.812926 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:56.911679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:56.911649 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.074361 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.074269 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.174239 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.174202 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.312188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.312152 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.370760 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.370728 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gqpvq"] Jul 23 04:40:57.395213 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.395172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.398198 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398172 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 04:40:57.398198 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398197 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 04:40:57.398442 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398209 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 04:40:57.398442 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398234 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 04:40:57.398442 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398215 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7zxn\"" Jul 23 04:40:57.398661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398602 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 04:40:57.398712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.398697 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 04:40:57.423535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.423491 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.533942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.533906 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-tls\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.533942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.533939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-root\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.533963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-sys\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.533998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.534030 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvzpb\" (UniqueName: \"kubernetes.io/projected/bcd26da0-2d55-453c-b804-a9d0980080b4-kube-api-access-fvzpb\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.534081 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-wtmp\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.534106 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-metrics-client-ca\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.534153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-textfile\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.534246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.534178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.585998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.585952 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.635381 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635381 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635351 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-tls\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-root\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-sys\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635506 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvzpb\" (UniqueName: \"kubernetes.io/projected/bcd26da0-2d55-453c-b804-a9d0980080b4-kube-api-access-fvzpb\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-root\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-wtmp\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635941 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-metrics-client-ca\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.635941 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635681 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-textfile\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.636033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-textfile\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.636033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.635976 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.636191 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.636041 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-sys\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.636191 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.636040 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-wtmp\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.636397 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.636324 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd26da0-2d55-453c-b804-a9d0980080b4-metrics-client-ca\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.638240 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.638195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-tls\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.638240 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.638209 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd26da0-2d55-453c-b804-a9d0980080b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.646890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.646860 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvzpb\" (UniqueName: \"kubernetes.io/projected/bcd26da0-2d55-453c-b804-a9d0980080b4-kube-api-access-fvzpb\") pod \"node-exporter-gqpvq\" (UID: \"bcd26da0-2d55-453c-b804-a9d0980080b4\") " pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.693424 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.693368 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.705178 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.704857 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqpvq" Jul 23 04:40:57.752531 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:40:57.752504 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd26da0_2d55_453c_b804_a9d0980080b4.slice/crio-cb791873b50704881d896138997dd2a628f261aa557118a4a9ae1b4d4faaf68f WatchSource:0}: Error finding container cb791873b50704881d896138997dd2a628f261aa557118a4a9ae1b4d4faaf68f: Status 404 returned error can't find the container with id cb791873b50704881d896138997dd2a628f261aa557118a4a9ae1b4d4faaf68f Jul 23 04:40:57.789429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.789386 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:57.897171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:57.897060 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.301598 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.301505 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.405926 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.405887 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.532774 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.532737 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.636271 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.636228 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.700595 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.700551 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqpvq" event={"ID":"bcd26da0-2d55-453c-b804-a9d0980080b4","Type":"ContainerStarted","Data":"cb791873b50704881d896138997dd2a628f261aa557118a4a9ae1b4d4faaf68f"} Jul 23 04:40:58.732870 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.732838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:40:58.887804 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.887743 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:58.887804 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.887805 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:58.892854 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:58.892830 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:59.705802 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:59.705767 2570 generic.go:356] "Generic (PLEG): container finished" podID="bcd26da0-2d55-453c-b804-a9d0980080b4" containerID="6f8420376297361db111d98664e7e508a338326195200a98bb31a599efb692ea" exitCode=0 Jul 23 04:40:59.706188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:59.705850 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqpvq" event={"ID":"bcd26da0-2d55-453c-b804-a9d0980080b4","Type":"ContainerDied","Data":"6f8420376297361db111d98664e7e508a338326195200a98bb31a599efb692ea"} Jul 23 04:40:59.710047 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:59.710025 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:40:59.901394 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:40:59.901355 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.014560 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.014469 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.212685 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.212647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.368034 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.368005 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.449872 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.449840 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.515003 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.514975 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:00.711721 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.711636 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqpvq" event={"ID":"bcd26da0-2d55-453c-b804-a9d0980080b4","Type":"ContainerStarted","Data":"c98f847a743cf4fe1a818ebf54d44aa11d242b6b136abecaf2f57fc1e8ffe4ad"} Jul 23 04:41:00.711721 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.711696 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqpvq" event={"ID":"bcd26da0-2d55-453c-b804-a9d0980080b4","Type":"ContainerStarted","Data":"9e93f6108e55551ec79f55443796a238b3795f8993ddab1d1c648ef5b0f37661"} Jul 23 04:41:00.734007 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:00.733952 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gqpvq" podStartSLOduration=2.537324179 podStartE2EDuration="3.733931169s" totalImagesPullingTime="1.124616969s" totalInitContainerRuntime="71.990021ms" isStatefulPod=true podCreationTimestamp="2026-07-23 04:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:41:00.732698778 +0000 UTC m=+113.968740036" watchObservedRunningTime="2026-07-23 04:41:00.733931169 +0000 UTC m=+113.969972425" Jul 23 04:41:01.009197 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:01.009101 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:02.117796 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.117753 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx"] Jul 23 04:41:02.122555 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.122528 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.124432 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.124401 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:02.127380 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.127364 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 04:41:02.127498 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.127484 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x75r6\"" Jul 23 04:41:02.134583 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.134553 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx"] Jul 23 04:41:02.259077 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.259039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:02.277787 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.277738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzjx\" (UniqueName: \"kubernetes.io/projected/f18e5fe2-0f33-476a-90fa-89feea060e14-kube-api-access-4gzjx\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.277896 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.277807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.379160 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.379065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.379327 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.379166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzjx\" (UniqueName: \"kubernetes.io/projected/f18e5fe2-0f33-476a-90fa-89feea060e14-kube-api-access-4gzjx\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.379327 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:41:02.379232 2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 04:41:02.379327 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:41:02.379316 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert podName:f18e5fe2-0f33-476a-90fa-89feea060e14 nodeName:}" failed. No retries permitted until 2026-07-23 04:41:02.87929415 +0000 UTC m=+116.115335390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-dv4jx" (UID: "f18e5fe2-0f33-476a-90fa-89feea060e14") : secret "monitoring-plugin-cert" not found Jul 23 04:41:02.389919 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.389883 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzjx\" (UniqueName: \"kubernetes.io/projected/f18e5fe2-0f33-476a-90fa-89feea060e14-kube-api-access-4gzjx\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.401004 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.400976 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:02.499095 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.499048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:02.883484 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.883444 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:02.886096 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:02.886064 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f18e5fe2-0f33-476a-90fa-89feea060e14-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-dv4jx\" (UID: \"f18e5fe2-0f33-476a-90fa-89feea060e14\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:03.032223 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:03.032178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:03.168658 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:03.168546 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx"] Jul 23 04:41:03.171701 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:41:03.171671 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18e5fe2_0f33_476a_90fa_89feea060e14.slice/crio-327aff51654118bdc7c3c3fcedd107c213de31c0c313bf7703b1bfb61192ae21 WatchSource:0}: Error finding container 327aff51654118bdc7c3c3fcedd107c213de31c0c313bf7703b1bfb61192ae21: Status 404 returned error can't find the container with id 327aff51654118bdc7c3c3fcedd107c213de31c0c313bf7703b1bfb61192ae21 Jul 23 04:41:03.624956 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:03.624904 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:03.724646 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:03.724577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" event={"ID":"f18e5fe2-0f33-476a-90fa-89feea060e14","Type":"ContainerStarted","Data":"327aff51654118bdc7c3c3fcedd107c213de31c0c313bf7703b1bfb61192ae21"} Jul 23 04:41:05.631722 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:05.631693 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:41:05.733752 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:05.733719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" event={"ID":"f18e5fe2-0f33-476a-90fa-89feea060e14","Type":"ContainerStarted","Data":"f3f402acd4bb59871bf3db5f5f07db8842fd7cc77e46291bf40ecd3f3f8b86cd"} Jul 23 04:41:05.734006 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:05.733990 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:05.738535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:05.738516 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" Jul 23 04:41:05.758196 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:05.758144 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-dv4jx" podStartSLOduration=1.70563618 podStartE2EDuration="3.758129197s" totalImagesPullingTime="2.052493017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:41:05.756482409 +0000 UTC m=+118.992523665" watchObservedRunningTime="2026-07-23 04:41:05.758129197 +0000 UTC m=+118.994170517" Jul 23 04:41:10.199879 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:10.199840 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:10.300652 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:10.300610 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:12.858976 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:12.858937 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:41:12.959641 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:12.959596 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:13.023475 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:13.023436 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:13.093698 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:13.093664 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:13.502046 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:13.502012 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:13.602339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:13.602303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:16.994699 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:16.994608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:41:16.997153 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:16.997128 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aacb3060-88cb-44f2-9e1d-5635b5ae4506-metrics-certs\") pod \"network-metrics-daemon-pcswx\" (UID: \"aacb3060-88cb-44f2-9e1d-5635b5ae4506\") " pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:41:17.092668 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:17.092614 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2njx\"" Jul 23 04:41:17.101582 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:17.101550 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pcswx" Jul 23 04:41:17.259344 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:17.259254 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pcswx"] Jul 23 04:41:17.262448 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:41:17.262409 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacb3060_88cb_44f2_9e1d_5635b5ae4506.slice/crio-91f1344e6f64063cd0e9d25823405bf2128d07f454621a1ecaf237b8bc0255ed WatchSource:0}: Error finding container 91f1344e6f64063cd0e9d25823405bf2128d07f454621a1ecaf237b8bc0255ed: Status 404 returned error can't find the container with id 91f1344e6f64063cd0e9d25823405bf2128d07f454621a1ecaf237b8bc0255ed Jul 23 04:41:17.779324 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:17.779285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pcswx" event={"ID":"aacb3060-88cb-44f2-9e1d-5635b5ae4506","Type":"ContainerStarted","Data":"91f1344e6f64063cd0e9d25823405bf2128d07f454621a1ecaf237b8bc0255ed"} Jul 23 04:41:18.784614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:18.784572 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pcswx" event={"ID":"aacb3060-88cb-44f2-9e1d-5635b5ae4506","Type":"ContainerStarted","Data":"21eabf065cbb3a12ebfd199f7db304d2e6afe9cd758041ac5706f197de37dd3f"} Jul 23 04:41:18.785075 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:18.784649 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pcswx" event={"ID":"aacb3060-88cb-44f2-9e1d-5635b5ae4506","Type":"ContainerStarted","Data":"ad458bc77a4e13f0364a9dcb1a29ae2a45bc99ac44be144538f83b44416860e7"} Jul 23 04:41:18.804563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:18.804514 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pcswx" podStartSLOduration=129.883312325 podStartE2EDuration="2m10.804499778s" totalImagesPullingTime="921.187453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:41:18.80374034 +0000 UTC m=+132.039781599" watchObservedRunningTime="2026-07-23 04:41:18.804499778 +0000 UTC m=+132.040541036" Jul 23 04:41:18.903995 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:18.903954 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:19.022456 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:19.022419 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:20.646352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.646303 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" podUID="82f5a2b0-728d-4020-8a6e-97187c32318a" containerName="registry" containerID="cri-o://3692cd7f9a41cde2fcff7a2d942310a0332c2748b2e3f11394ea8c0898cb83d4" gracePeriod=30 Jul 23 04:41:20.793847 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.793812 2570 generic.go:356] "Generic (PLEG): container finished" podID="82f5a2b0-728d-4020-8a6e-97187c32318a" containerID="3692cd7f9a41cde2fcff7a2d942310a0332c2748b2e3f11394ea8c0898cb83d4" exitCode=0 Jul 23 04:41:20.794019 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.793871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" event={"ID":"82f5a2b0-728d-4020-8a6e-97187c32318a","Type":"ContainerDied","Data":"3692cd7f9a41cde2fcff7a2d942310a0332c2748b2e3f11394ea8c0898cb83d4"} Jul 23 04:41:20.901041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.900981 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:41:20.927236 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927205 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927246 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927288 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927315 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927342 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927377 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927414 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.927468 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927448 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc7mh\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh\") pod \"82f5a2b0-728d-4020-8a6e-97187c32318a\" (UID: \"82f5a2b0-728d-4020-8a6e-97187c32318a\") " Jul 23 04:41:20.928192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.927950 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:20.929920 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.929886 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:20.930275 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.930247 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:41:20.930867 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.930826 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh" (OuterVolumeSpecName: "kube-api-access-qc7mh") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "kube-api-access-qc7mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:41:20.930972 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.930882 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:41:20.931931 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.931904 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:41:20.932504 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.932475 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:41:20.937109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:20.937084 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82f5a2b0-728d-4020-8a6e-97187c32318a" (UID: "82f5a2b0-728d-4020-8a6e-97187c32318a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:41:21.028822 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028788 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-tls\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.028822 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028816 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-bound-sa-token\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.028822 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028827 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82f5a2b0-728d-4020-8a6e-97187c32318a-ca-trust-extracted\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.029052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028837 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-installation-pull-secrets\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.029052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028845 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-registry-certificates\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.029052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028856 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82f5a2b0-728d-4020-8a6e-97187c32318a-trusted-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.029052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028865 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82f5a2b0-728d-4020-8a6e-97187c32318a-image-registry-private-configuration\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.029052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.028875 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc7mh\" (UniqueName: \"kubernetes.io/projected/82f5a2b0-728d-4020-8a6e-97187c32318a-kube-api-access-qc7mh\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:21.798480 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.798438 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" event={"ID":"82f5a2b0-728d-4020-8a6e-97187c32318a","Type":"ContainerDied","Data":"27de78cf99214a396c6784a04083ecf380c333e4f2bbd9f47549e9ddfe12b026"} Jul 23 04:41:21.798480 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.798470 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d4fc9bff4-s42tf" Jul 23 04:41:21.799043 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.798501 2570 scope.go:117] "RemoveContainer" containerID="3692cd7f9a41cde2fcff7a2d942310a0332c2748b2e3f11394ea8c0898cb83d4" Jul 23 04:41:21.817679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.817639 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:41:21.822297 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:21.822268 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d4fc9bff4-s42tf"] Jul 23 04:41:23.176990 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:23.176951 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82f5a2b0-728d-4020-8a6e-97187c32318a" path="/var/lib/kubelet/pods/82f5a2b0-728d-4020-8a6e-97187c32318a/volumes" Jul 23 04:41:28.507202 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:28.507160 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:28.611116 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:28.611085 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:35.254381 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:35.254342 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:35.388830 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:35.388791 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:35.489538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:35.489501 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:35.550405 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:35.550325 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:36.744967 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:36.744931 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:36.847837 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:36.847798 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:37.880062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:37.880020 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-775bd65dc-5pdsf" podUID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" containerName="console" containerID="cri-o://431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd" gracePeriod=15 Jul 23 04:41:38.140699 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.140602 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:41:38.265060 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.264998 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f85zq\" (UniqueName: \"kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265060 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265063 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265101 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265139 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265177 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265208 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265246 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config\") pod \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\" (UID: \"2eb74d9f-8d02-47f1-9589-e06f35b59a70\") " Jul 23 04:41:38.265718 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265682 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca" (OuterVolumeSpecName: "service-ca") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:38.265718 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265697 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:38.265846 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265709 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:38.265846 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.265783 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config" (OuterVolumeSpecName: "console-config") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:41:38.267559 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.267530 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:41:38.267559 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.267551 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:41:38.267716 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.267588 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq" (OuterVolumeSpecName: "kube-api-access-f85zq") pod "2eb74d9f-8d02-47f1-9589-e06f35b59a70" (UID: "2eb74d9f-8d02-47f1-9589-e06f35b59a70"). InnerVolumeSpecName "kube-api-access-f85zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:41:38.366037 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.365991 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366037 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366033 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366037 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366043 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366037 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366053 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366062 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f85zq\" (UniqueName: \"kubernetes.io/projected/2eb74d9f-8d02-47f1-9589-e06f35b59a70-kube-api-access-f85zq\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366070 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eb74d9f-8d02-47f1-9589-e06f35b59a70-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.366300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.366080 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eb74d9f-8d02-47f1-9589-e06f35b59a70-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:41:38.861331 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.861290 2570 generic.go:356] "Generic (PLEG): container finished" podID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" containerID="431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd" exitCode=0 Jul 23 04:41:38.861517 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.861342 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775bd65dc-5pdsf" Jul 23 04:41:38.861517 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.861372 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775bd65dc-5pdsf" event={"ID":"2eb74d9f-8d02-47f1-9589-e06f35b59a70","Type":"ContainerDied","Data":"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd"} Jul 23 04:41:38.861517 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.861427 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775bd65dc-5pdsf" event={"ID":"2eb74d9f-8d02-47f1-9589-e06f35b59a70","Type":"ContainerDied","Data":"2257985364dd4897f64f1c739483c03e5db72d2c0fd9dbad5b201183b680d3ed"} Jul 23 04:41:38.861517 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.861448 2570 scope.go:117] "RemoveContainer" containerID="431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd" Jul 23 04:41:38.870430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.870409 2570 scope.go:117] "RemoveContainer" containerID="431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd" Jul 23 04:41:38.870748 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:41:38.870723 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd\": container with ID starting with 431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd not found: ID does not exist" containerID="431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd" Jul 23 04:41:38.870820 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.870757 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd"} err="failed to get container status \"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd\": rpc error: code = NotFound desc = could not find container \"431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd\": container with ID starting with 431465ad39f9975ba051581d86d8268f7913af20b1e9def43ee699f5c0c206bd not found: ID does not exist" Jul 23 04:41:38.884302 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.884273 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:41:38.889133 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:38.889105 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-775bd65dc-5pdsf"] Jul 23 04:41:39.177273 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:39.177181 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" path="/var/lib/kubelet/pods/2eb74d9f-8d02-47f1-9589-e06f35b59a70/volumes" Jul 23 04:41:42.652339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:42.652306 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:41:42.751176 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:41:42.751147 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:16.665542 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:16.665503 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:16.967876 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:16.967780 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:20.162151 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162117 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162402 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f5a2b0-728d-4020-8a6e-97187c32318a" containerName="registry" Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162418 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f5a2b0-728d-4020-8a6e-97187c32318a" containerName="registry" Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162428 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" containerName="console" Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162434 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" containerName="console" Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162485 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f5a2b0-728d-4020-8a6e-97187c32318a" containerName="registry" Jul 23 04:42:20.162533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.162495 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb74d9f-8d02-47f1-9589-e06f35b59a70" containerName="console" Jul 23 04:42:20.167362 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.167343 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.169853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.169822 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 04:42:20.169997 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.169833 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 04:42:20.169997 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.169869 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 04:42:20.169997 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.169868 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 04:42:20.169997 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.169987 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 04:42:20.170334 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.170319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 04:42:20.170386 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.170341 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q5pv2\"" Jul 23 04:42:20.170440 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.170322 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 04:42:20.175469 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.175451 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 04:42:20.178689 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.178793 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.178793 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178725 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.178902 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.178902 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.178902 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2vg\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-kube-api-access-2m2vg\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.178955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.179004 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-out\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.179042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-web-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179238 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.179067 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179238 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.179104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.179238 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.179134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.181236 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.181218 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 04:42:20.183966 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.183940 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 04:42:20.279967 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.279909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2vg\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-kube-api-access-2m2vg\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280189 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.279979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280189 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280007 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-out\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280189 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-web-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280189 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280388 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280388 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280501 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280501 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.280943 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.281001 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.280960 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.281535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.281509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.283424 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.283665 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-out\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.283815 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.283874 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31c547fc-05ae-44eb-9b47-2e2670f2c13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.284011 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-web-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.284018 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.284272 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.283723 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.284291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.285147 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.285129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.285253 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.285235 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31c547fc-05ae-44eb-9b47-2e2670f2c13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.289636 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.289595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2vg\" (UniqueName: \"kubernetes.io/projected/31c547fc-05ae-44eb-9b47-2e2670f2c13a-kube-api-access-2m2vg\") pod \"alertmanager-main-0\" (UID: \"31c547fc-05ae-44eb-9b47-2e2670f2c13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.477009 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.476909 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 04:42:20.654828 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:20.654776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 04:42:20.659568 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:42:20.659535 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c547fc_05ae_44eb_9b47_2e2670f2c13a.slice/crio-8beaaa258d46089b4bbebd44fef69f6041159f75b4bfa9e54f6bf7fedf5e222f WatchSource:0}: Error finding container 8beaaa258d46089b4bbebd44fef69f6041159f75b4bfa9e54f6bf7fedf5e222f: Status 404 returned error can't find the container with id 8beaaa258d46089b4bbebd44fef69f6041159f75b4bfa9e54f6bf7fedf5e222f Jul 23 04:42:21.018110 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.018073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"8beaaa258d46089b4bbebd44fef69f6041159f75b4bfa9e54f6bf7fedf5e222f"} Jul 23 04:42:21.754744 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.754714 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7878b5dd97-zwpzc"] Jul 23 04:42:21.759170 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.759150 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.761544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.761505 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 04:42:21.761686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.761549 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 04:42:21.761686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.761655 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 04:42:21.761914 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.761893 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 04:42:21.761981 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.761904 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5gdhb\"" Jul 23 04:42:21.762357 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.762333 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 04:42:21.766978 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.766956 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 04:42:21.771880 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.771857 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7878b5dd97-zwpzc"] Jul 23 04:42:21.793792 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-serving-certs-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.793938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.793938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-federate-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.793938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfn76\" (UniqueName: \"kubernetes.io/projected/188b32c7-9511-458d-960c-ae4629042a99-kube-api-access-gfn76\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.793938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793910 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-telemeter-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.793938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-metrics-client-ca\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.794097 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.793970 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.794097 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.794015 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895172 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895172 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-federate-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfn76\" (UniqueName: \"kubernetes.io/projected/188b32c7-9511-458d-960c-ae4629042a99-kube-api-access-gfn76\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-telemeter-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895265 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-metrics-client-ca\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.895429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.895379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-serving-certs-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.896417 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.896386 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-metrics-client-ca\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.896596 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.896566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.897052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.897026 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/188b32c7-9511-458d-960c-ae4629042a99-serving-certs-ca-bundle\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.897981 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.897950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.898095 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.898038 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-telemeter-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.898095 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.898045 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-federate-client-tls\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.898219 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.898197 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/188b32c7-9511-458d-960c-ae4629042a99-secret-telemeter-client\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:21.904903 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:21.904878 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfn76\" (UniqueName: \"kubernetes.io/projected/188b32c7-9511-458d-960c-ae4629042a99-kube-api-access-gfn76\") pod \"telemeter-client-7878b5dd97-zwpzc\" (UID: \"188b32c7-9511-458d-960c-ae4629042a99\") " pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:22.023173 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:22.023076 2570 generic.go:356] "Generic (PLEG): container finished" podID="31c547fc-05ae-44eb-9b47-2e2670f2c13a" containerID="d45aca0246e0162cdb8cecb035f13d36ba3a99cb1620f133404c331fa2c63709" exitCode=0 Jul 23 04:42:22.023173 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:22.023143 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerDied","Data":"d45aca0246e0162cdb8cecb035f13d36ba3a99cb1620f133404c331fa2c63709"} Jul 23 04:42:22.089386 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:22.089350 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" Jul 23 04:42:22.225909 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:22.225806 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7878b5dd97-zwpzc"] Jul 23 04:42:22.228382 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:42:22.228350 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188b32c7_9511_458d_960c_ae4629042a99.slice/crio-b012dd6b57b5ed7512effc2547a7c137c4f3d36baac636056039330edc811cab WatchSource:0}: Error finding container b012dd6b57b5ed7512effc2547a7c137c4f3d36baac636056039330edc811cab: Status 404 returned error can't find the container with id b012dd6b57b5ed7512effc2547a7c137c4f3d36baac636056039330edc811cab Jul 23 04:42:23.029288 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:23.029249 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" event={"ID":"188b32c7-9511-458d-960c-ae4629042a99","Type":"ContainerStarted","Data":"b012dd6b57b5ed7512effc2547a7c137c4f3d36baac636056039330edc811cab"} Jul 23 04:42:24.036197 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:24.036162 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"a04b4c5e465008f0964bbe4d24bc4d91294b788108b4836814983adb9c9b3157"} Jul 23 04:42:24.036635 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:24.036237 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"471a77021ab35421fed975fac318dd5cd87a6a6d09f2d01092e2c12f52eb4f60"} Jul 23 04:42:25.043181 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.043146 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"60d2f459e4bbaad0509484e49437dfea228d569c7bb182f876c05f4c2c3cd8e2"} Jul 23 04:42:25.043571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.043217 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"e2e8820f3c045d1a629b806d401c3dccf46c729519ad0a22b15ed8cdce8a27a5"} Jul 23 04:42:25.043571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.043250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"5413a43c134286563fb973d0aaa6d23b8c18ae1c52f87d781332c75ad38beb0f"} Jul 23 04:42:25.045444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.045415 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" event={"ID":"188b32c7-9511-458d-960c-ae4629042a99","Type":"ContainerStarted","Data":"f44f6d42167ccf351514472ea31b7878ff5fd43d0ab6e92ea81a0818a9b0f7ec"} Jul 23 04:42:25.045576 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.045481 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" event={"ID":"188b32c7-9511-458d-960c-ae4629042a99","Type":"ContainerStarted","Data":"31e593125914654dc3cc9914c8e526dc94ec439894fdef4378b6e316400d90af"} Jul 23 04:42:25.045576 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.045510 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" event={"ID":"188b32c7-9511-458d-960c-ae4629042a99","Type":"ContainerStarted","Data":"a2e839af63919637d26ed4aed064c3c7b40747368485150bab0c0150f61cb235"} Jul 23 04:42:25.070773 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.070714 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7878b5dd97-zwpzc" podStartSLOduration=2.132714954 podStartE2EDuration="4.070692649s" totalImagesPullingTime="1.937977695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:42:25.068381144 +0000 UTC m=+198.304422401" watchObservedRunningTime="2026-07-23 04:42:25.070692649 +0000 UTC m=+198.306733907" Jul 23 04:42:25.831233 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.831200 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:42:25.834756 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.834731 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.837198 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.837118 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 04:42:25.837198 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.837120 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 04:42:25.837388 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.837206 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 04:42:25.838103 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.838009 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 04:42:25.838358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.838143 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 04:42:25.838358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.838164 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 04:42:25.838358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.838326 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 04:42:25.838592 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.838438 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-25b8x\"" Jul 23 04:42:25.845166 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.844819 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 04:42:25.848187 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.848162 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:42:25.889033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.888983 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:25.930222 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930222 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjmn\" (UniqueName: \"kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930274 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930323 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:25.930439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:25.930339 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030769 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjmn\" (UniqueName: \"kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030769 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030841 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030911 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.030993 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.030970 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.031686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.031658 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.031814 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.031672 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.031814 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.031744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.031999 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.031971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.033490 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.033462 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.033630 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.033491 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.040460 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.040432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjmn\" (UniqueName: \"kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn\") pod \"console-d97547754-9zkk2\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.053161 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.053132 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31c547fc-05ae-44eb-9b47-2e2670f2c13a","Type":"ContainerStarted","Data":"57ec186fe2019dd26119eeb5bd2ac0cc8d2de48bfd678b2082093f38580d689c"} Jul 23 04:42:26.082182 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.082058 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.555139791 podStartE2EDuration="6.082038426s" totalImagesPullingTime="3.510599091s" totalInitContainerRuntime="16.299544ms" isStatefulPod=false podCreationTimestamp="2026-07-23 04:42:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:42:26.080504501 +0000 UTC m=+199.316545758" watchObservedRunningTime="2026-07-23 04:42:26.082038426 +0000 UTC m=+199.318079685" Jul 23 04:42:26.087276 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.087249 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:26.152637 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.152572 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:26.295340 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.295310 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:42:26.297770 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:42:26.297741 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca9690b_7a9f_45b9_9399_9ac3c36460a0.slice/crio-30e0dc4d3ccf1172adea2b80a81ea9a237726e36c05b8c88d52b0f82fdbfa5e2 WatchSource:0}: Error finding container 30e0dc4d3ccf1172adea2b80a81ea9a237726e36c05b8c88d52b0f82fdbfa5e2: Status 404 returned error can't find the container with id 30e0dc4d3ccf1172adea2b80a81ea9a237726e36c05b8c88d52b0f82fdbfa5e2 Jul 23 04:42:26.639024 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.638992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:26.696927 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:26.696878 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:27.061536 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:27.061447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97547754-9zkk2" event={"ID":"4ca9690b-7a9f-45b9-9399-9ac3c36460a0","Type":"ContainerStarted","Data":"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a"} Jul 23 04:42:27.061536 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:27.061502 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97547754-9zkk2" event={"ID":"4ca9690b-7a9f-45b9-9399-9ac3c36460a0","Type":"ContainerStarted","Data":"30e0dc4d3ccf1172adea2b80a81ea9a237726e36c05b8c88d52b0f82fdbfa5e2"} Jul 23 04:42:27.080540 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:27.080483 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d97547754-9zkk2" podStartSLOduration=2.080460118 podStartE2EDuration="2.080460118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:42:27.07935381 +0000 UTC m=+200.315395058" watchObservedRunningTime="2026-07-23 04:42:27.080460118 +0000 UTC m=+200.316501400" Jul 23 04:42:36.153145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:36.153104 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:36.153568 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:36.153193 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:36.158165 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:36.158128 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:37.106306 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:37.106278 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:42:37.280039 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:37.280008 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:37.381640 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:37.381599 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:42:37.454884 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:42:37.454851 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:12.793495 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:12.793462 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:12.892840 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:12.892803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:31.916807 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:31.916724 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:31.977823 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:31.977789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:42.988036 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:42.987986 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:43:42.991472 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:42.991448 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.005686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.005653 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:43:43.056845 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.056808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.056845 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.056848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.057115 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.056874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.057115 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.056959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8xk\" (UniqueName: \"kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.057115 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.057034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.057115 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.057096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.057282 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.057135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.058963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.058939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:43.122650 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.122589 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:43.157750 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.157717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.157877 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.157759 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8xk\" (UniqueName: \"kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.157877 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.157780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.157877 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.157813 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158031 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158163 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158163 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158602 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158578 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158792 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158771 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158876 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.158876 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.158828 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.161084 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.161058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.161189 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.161167 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.166845 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.166823 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8xk\" (UniqueName: \"kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk\") pod \"console-cd9f4d555-nlp9d\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.301987 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.301890 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:43.438947 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.438917 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:43:43.441546 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:43:43.441520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d45458_f8b1_4557_8004_40e1125dbd83.slice/crio-bf34c939296ed9822a61ff5c685ba34996dfc6e60428e34069819b51066bee1a WatchSource:0}: Error finding container bf34c939296ed9822a61ff5c685ba34996dfc6e60428e34069819b51066bee1a: Status 404 returned error can't find the container with id bf34c939296ed9822a61ff5c685ba34996dfc6e60428e34069819b51066bee1a Jul 23 04:43:43.860738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.860706 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:43.918601 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:43.918542 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:44.365236 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:44.365203 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f4d555-nlp9d" event={"ID":"c0d45458-f8b1-4557-8004-40e1125dbd83","Type":"ContainerStarted","Data":"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65"} Jul 23 04:43:44.365641 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:44.365252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f4d555-nlp9d" event={"ID":"c0d45458-f8b1-4557-8004-40e1125dbd83","Type":"ContainerStarted","Data":"bf34c939296ed9822a61ff5c685ba34996dfc6e60428e34069819b51066bee1a"} Jul 23 04:43:53.302367 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.302324 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:53.302872 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.302385 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:53.311196 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.311168 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:53.330553 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.330496 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd9f4d555-nlp9d" podStartSLOduration=11.330479908 podStartE2EDuration="11.330479908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:43:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:43:44.397719293 +0000 UTC m=+277.633760549" watchObservedRunningTime="2026-07-23 04:43:53.330479908 +0000 UTC m=+286.566521165" Jul 23 04:43:53.403517 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.403490 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:43:53.452683 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.452651 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:43:53.572524 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.572449 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:53.672824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.672784 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:53.734527 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:53.734497 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:58.511720 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:58.511680 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:43:58.610579 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:43:58.610542 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:04.631173 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:04.631142 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:07.081314 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:07.081281 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:44:07.084762 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:07.084734 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:44:07.092229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:07.092206 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 04:44:18.475002 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.474937 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d97547754-9zkk2" podUID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" containerName="console" containerID="cri-o://fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a" gracePeriod=15 Jul 23 04:44:18.725545 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.725486 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:44:18.756364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756334 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756372 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756640 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756409 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mjmn\" (UniqueName: \"kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756640 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756530 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756640 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756631 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756790 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756695 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756790 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756733 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config\") pod \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\" (UID: \"4ca9690b-7a9f-45b9-9399-9ac3c36460a0\") " Jul 23 04:44:18.756889 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756830 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config" (OuterVolumeSpecName: "console-config") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:44:18.756987 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.756967 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.757109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.757014 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:44:18.757170 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.757134 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:44:18.757289 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.757263 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:44:18.758996 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.758970 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn" (OuterVolumeSpecName: "kube-api-access-9mjmn") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "kube-api-access-9mjmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:44:18.759393 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.759374 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:44:18.759456 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.759404 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ca9690b-7a9f-45b9-9399-9ac3c36460a0" (UID: "4ca9690b-7a9f-45b9-9399-9ac3c36460a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:44:18.858276 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858237 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.858276 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858271 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.858276 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858281 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.858505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858290 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.858505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858298 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mjmn\" (UniqueName: \"kubernetes.io/projected/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-kube-api-access-9mjmn\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:18.858505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:18.858305 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ca9690b-7a9f-45b9-9399-9ac3c36460a0-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:44:19.498029 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.497939 2570 generic.go:356] "Generic (PLEG): container finished" podID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" containerID="fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a" exitCode=0 Jul 23 04:44:19.498029 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.497983 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97547754-9zkk2" Jul 23 04:44:19.498491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.498037 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97547754-9zkk2" event={"ID":"4ca9690b-7a9f-45b9-9399-9ac3c36460a0","Type":"ContainerDied","Data":"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a"} Jul 23 04:44:19.498491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.498092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97547754-9zkk2" event={"ID":"4ca9690b-7a9f-45b9-9399-9ac3c36460a0","Type":"ContainerDied","Data":"30e0dc4d3ccf1172adea2b80a81ea9a237726e36c05b8c88d52b0f82fdbfa5e2"} Jul 23 04:44:19.498491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.498121 2570 scope.go:117] "RemoveContainer" containerID="fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a" Jul 23 04:44:19.506332 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.506313 2570 scope.go:117] "RemoveContainer" containerID="fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a" Jul 23 04:44:19.506599 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:44:19.506579 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a\": container with ID starting with fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a not found: ID does not exist" containerID="fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a" Jul 23 04:44:19.506685 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.506609 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a"} err="failed to get container status \"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a\": rpc error: code = NotFound desc = could not find container \"fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a\": container with ID starting with fdaa41cb48b93a57ddceff464ba3769589db192abf5a12a86f07cbecfdb4272a not found: ID does not exist" Jul 23 04:44:19.520366 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.520338 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:44:19.525358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:19.525335 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d97547754-9zkk2"] Jul 23 04:44:21.177677 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:21.177645 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" path="/var/lib/kubelet/pods/4ca9690b-7a9f-45b9-9399-9ac3c36460a0/volumes" Jul 23 04:44:38.133134 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:38.133094 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:39.379342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:39.379312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:39.668293 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:39.668208 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:39.770079 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:39.770043 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:44:40.394968 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.394938 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q"] Jul 23 04:44:40.395335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.395222 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" containerName="console" Jul 23 04:44:40.395335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.395232 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" containerName="console" Jul 23 04:44:40.395335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.395279 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca9690b-7a9f-45b9-9399-9ac3c36460a0" containerName="console" Jul 23 04:44:40.398450 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.398425 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.400935 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.400901 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 04:44:40.401050 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.400978 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 04:44:40.401050 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.401019 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f595s\"" Jul 23 04:44:40.408777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.408752 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q"] Jul 23 04:44:40.528681 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.528612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.528855 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.528695 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.528855 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.528726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmw6\" (UniqueName: \"kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.629469 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.629435 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.629709 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.629496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmw6\" (UniqueName: \"kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.629709 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.629580 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.629869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.629849 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.629952 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.629931 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.639300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.639276 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmw6\" (UniqueName: \"kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.708458 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.708373 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:44:40.844272 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.844238 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q"] Jul 23 04:44:40.847851 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:44:40.847823 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d833d9_2b12_460f_98dc_9161faefe978.slice/crio-621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6 WatchSource:0}: Error finding container 621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6: Status 404 returned error can't find the container with id 621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6 Jul 23 04:44:40.850074 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:40.850054 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 04:44:41.583632 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:41.583595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerStarted","Data":"621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6"} Jul 23 04:44:48.611977 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:48.611942 2570 generic.go:356] "Generic (PLEG): container finished" podID="15d833d9-2b12-460f-98dc-9161faefe978" containerID="8d8eff40435a39615a59ff6a035991402397d5b4223cd6e7e42c65d1f8737b7d" exitCode=0 Jul 23 04:44:48.612433 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:48.612032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerDied","Data":"8d8eff40435a39615a59ff6a035991402397d5b4223cd6e7e42c65d1f8737b7d"} Jul 23 04:44:50.623672 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:50.623594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerStarted","Data":"9e9af03bb639148456a02e4f1223d6d0a5878ce86eee70c86b9e5410fbc04538"} Jul 23 04:44:51.629286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:51.629253 2570 generic.go:356] "Generic (PLEG): container finished" podID="15d833d9-2b12-460f-98dc-9161faefe978" containerID="9e9af03bb639148456a02e4f1223d6d0a5878ce86eee70c86b9e5410fbc04538" exitCode=0 Jul 23 04:44:51.629842 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:51.629336 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerDied","Data":"9e9af03bb639148456a02e4f1223d6d0a5878ce86eee70c86b9e5410fbc04538"} Jul 23 04:44:59.665772 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:59.665734 2570 generic.go:356] "Generic (PLEG): container finished" podID="15d833d9-2b12-460f-98dc-9161faefe978" containerID="4c7e3f2d1cd3d7c0a1eb14cdb2bb23915897d2a019c03be6b6f3c3ac0788a208" exitCode=0 Jul 23 04:44:59.666153 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:44:59.665819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerDied","Data":"4c7e3f2d1cd3d7c0a1eb14cdb2bb23915897d2a019c03be6b6f3c3ac0788a208"} Jul 23 04:45:00.844598 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:00.844565 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:45:01.008158 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.008063 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle\") pod \"15d833d9-2b12-460f-98dc-9161faefe978\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " Jul 23 04:45:01.008158 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.008142 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util\") pod \"15d833d9-2b12-460f-98dc-9161faefe978\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " Jul 23 04:45:01.008374 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.008169 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlmw6\" (UniqueName: \"kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6\") pod \"15d833d9-2b12-460f-98dc-9161faefe978\" (UID: \"15d833d9-2b12-460f-98dc-9161faefe978\") " Jul 23 04:45:01.008773 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.008750 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle" (OuterVolumeSpecName: "bundle") pod "15d833d9-2b12-460f-98dc-9161faefe978" (UID: "15d833d9-2b12-460f-98dc-9161faefe978"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:01.010612 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.010580 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6" (OuterVolumeSpecName: "kube-api-access-jlmw6") pod "15d833d9-2b12-460f-98dc-9161faefe978" (UID: "15d833d9-2b12-460f-98dc-9161faefe978"). InnerVolumeSpecName "kube-api-access-jlmw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:45:01.013320 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.013297 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util" (OuterVolumeSpecName: "util") pod "15d833d9-2b12-460f-98dc-9161faefe978" (UID: "15d833d9-2b12-460f-98dc-9161faefe978"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:01.109547 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.109509 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:01.109547 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.109541 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlmw6\" (UniqueName: \"kubernetes.io/projected/15d833d9-2b12-460f-98dc-9161faefe978-kube-api-access-jlmw6\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:01.109547 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.109552 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15d833d9-2b12-460f-98dc-9161faefe978-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:01.674400 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.674371 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" Jul 23 04:45:01.674400 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.674385 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnt2q" event={"ID":"15d833d9-2b12-460f-98dc-9161faefe978","Type":"ContainerDied","Data":"621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6"} Jul 23 04:45:01.674629 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:01.674428 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="621a979bf2b31712281439824d4da121e2dfed08cfa1e5c815f03e18e59655e6" Jul 23 04:45:06.517235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:06.517203 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:07.522268 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:07.522228 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:08.481358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481322 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v"] Jul 23 04:45:08.481608 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481597 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="util" Jul 23 04:45:08.481679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481610 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="util" Jul 23 04:45:08.481679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481633 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="extract" Jul 23 04:45:08.481679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481638 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="extract" Jul 23 04:45:08.481679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481653 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="pull" Jul 23 04:45:08.481679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481658 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="pull" Jul 23 04:45:08.481821 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.481717 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d833d9-2b12-460f-98dc-9161faefe978" containerName="extract" Jul 23 04:45:08.485939 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.485920 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.488188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.488158 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 23 04:45:08.488188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.488174 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:45:08.488376 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.488174 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rrxzl\"" Jul 23 04:45:08.498552 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.498527 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v"] Jul 23 04:45:08.671573 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.671533 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzbr\" (UniqueName: \"kubernetes.io/projected/b881f6ec-b7ca-41b0-8a3c-a22732880945-kube-api-access-4xzbr\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.671991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.671583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881f6ec-b7ca-41b0-8a3c-a22732880945-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.772339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.772245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzbr\" (UniqueName: \"kubernetes.io/projected/b881f6ec-b7ca-41b0-8a3c-a22732880945-kube-api-access-4xzbr\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.772339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.772299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881f6ec-b7ca-41b0-8a3c-a22732880945-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.772720 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.772704 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b881f6ec-b7ca-41b0-8a3c-a22732880945-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.784312 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.784280 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzbr\" (UniqueName: \"kubernetes.io/projected/b881f6ec-b7ca-41b0-8a3c-a22732880945-kube-api-access-4xzbr\") pod \"cert-manager-operator-controller-manager-55c444bf86-zvq4v\" (UID: \"b881f6ec-b7ca-41b0-8a3c-a22732880945\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.795086 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.795060 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" Jul 23 04:45:08.930097 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:08.930071 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v"] Jul 23 04:45:08.932802 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:08.932772 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb881f6ec_b7ca_41b0_8a3c_a22732880945.slice/crio-d092112695669d4351b6f3feb9d703b90ec6b8bd936912ed37a7c318d5ddca61 WatchSource:0}: Error finding container d092112695669d4351b6f3feb9d703b90ec6b8bd936912ed37a7c318d5ddca61: Status 404 returned error can't find the container with id d092112695669d4351b6f3feb9d703b90ec6b8bd936912ed37a7c318d5ddca61 Jul 23 04:45:09.706658 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:09.706604 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" event={"ID":"b881f6ec-b7ca-41b0-8a3c-a22732880945","Type":"ContainerStarted","Data":"d092112695669d4351b6f3feb9d703b90ec6b8bd936912ed37a7c318d5ddca61"} Jul 23 04:45:10.104918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:10.104828 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:10.168865 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:10.168831 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:10.712728 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:10.712691 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" event={"ID":"b881f6ec-b7ca-41b0-8a3c-a22732880945","Type":"ContainerStarted","Data":"23806228c501cf56899e152b02b0684e83911cf33b6ccf49e29fe8d27b979486"} Jul 23 04:45:10.742718 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:10.742651 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zvq4v" podStartSLOduration=1.156816802 podStartE2EDuration="2.742606656s" totalImagesPullingTime="1.585789854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:45:10.741514203 +0000 UTC m=+363.977555459" watchObservedRunningTime="2026-07-23 04:45:10.742606656 +0000 UTC m=+363.978647913" Jul 23 04:45:11.473611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:11.473574 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:11.628093 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:11.628055 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:12.131398 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.131365 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb"] Jul 23 04:45:12.134920 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.134903 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.138477 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.138447 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f595s\"" Jul 23 04:45:12.138807 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.138784 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 04:45:12.139147 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.139130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 04:45:12.145175 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.145152 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb"] Jul 23 04:45:12.194963 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.194929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvbd\" (UniqueName: \"kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.195192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.195042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.195192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.195100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.233576 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.233542 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:12.295478 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.295442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chvbd\" (UniqueName: \"kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.295670 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.295503 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.295670 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.295532 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.295912 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.295896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.295961 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.295923 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.308857 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.308826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvbd\" (UniqueName: \"kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.352240 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.352213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:12.444676 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.444560 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:12.574694 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.574509 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb"] Jul 23 04:45:12.576803 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:12.576780 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47883f11_cf9a_4614_934a_02489130b790.slice/crio-66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d WatchSource:0}: Error finding container 66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d: Status 404 returned error can't find the container with id 66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d Jul 23 04:45:12.723679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.723592 2570 generic.go:356] "Generic (PLEG): container finished" podID="47883f11-cf9a-4614-934a-02489130b790" containerID="33317371a5e0399ab3ef75e07e9c574e65e94478e705745e1f3978a00237276a" exitCode=0 Jul 23 04:45:12.723679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.723647 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" event={"ID":"47883f11-cf9a-4614-934a-02489130b790","Type":"ContainerDied","Data":"33317371a5e0399ab3ef75e07e9c574e65e94478e705745e1f3978a00237276a"} Jul 23 04:45:12.723849 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:12.723696 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" event={"ID":"47883f11-cf9a-4614-934a-02489130b790","Type":"ContainerStarted","Data":"66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d"} Jul 23 04:45:14.252114 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:14.252075 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:14.646584 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:14.646549 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:14.734578 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:14.734548 2570 generic.go:356] "Generic (PLEG): container finished" podID="47883f11-cf9a-4614-934a-02489130b790" containerID="d02419c93aac053f1199b9e4d7ad38d1349c374966c47d12d11bda4527d84d3f" exitCode=0 Jul 23 04:45:14.734757 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:14.734614 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" event={"ID":"47883f11-cf9a-4614-934a-02489130b790","Type":"ContainerDied","Data":"d02419c93aac053f1199b9e4d7ad38d1349c374966c47d12d11bda4527d84d3f"} Jul 23 04:45:15.336343 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.336306 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv"] Jul 23 04:45:15.339632 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.339595 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.341858 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.341829 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 04:45:15.341998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.341954 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 04:45:15.341998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.341957 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8z7qp\"" Jul 23 04:45:15.348868 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.348848 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv"] Jul 23 04:45:15.422406 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.422378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.422406 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.422412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8486q\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-kube-api-access-8486q\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.523826 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.523786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.523826 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.523829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8486q\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-kube-api-access-8486q\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.532377 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.532340 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.532571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.532548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8486q\" (UniqueName: \"kubernetes.io/projected/4e5eec36-2a43-4353-8abe-8862c87e5ba8-kube-api-access-8486q\") pod \"cert-manager-cainjector-559cdd8c87-mwzwv\" (UID: \"4e5eec36-2a43-4353-8abe-8862c87e5ba8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.649317 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.649284 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" Jul 23 04:45:15.742848 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.742815 2570 generic.go:356] "Generic (PLEG): container finished" podID="47883f11-cf9a-4614-934a-02489130b790" containerID="a988d8aad0e5f64dcdf0fba3b4f2d2804e1f4314135e45dd6b0ad5c765fd0255" exitCode=0 Jul 23 04:45:15.743010 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.742879 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" event={"ID":"47883f11-cf9a-4614-934a-02489130b790","Type":"ContainerDied","Data":"a988d8aad0e5f64dcdf0fba3b4f2d2804e1f4314135e45dd6b0ad5c765fd0255"} Jul 23 04:45:15.788052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:15.787902 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv"] Jul 23 04:45:15.790637 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:15.790590 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e5eec36_2a43_4353_8abe_8862c87e5ba8.slice/crio-e8be2fc252c9b4b5f76913308b6b8b792a5ce1d3184765cc1368e381bd9f5e34 WatchSource:0}: Error finding container e8be2fc252c9b4b5f76913308b6b8b792a5ce1d3184765cc1368e381bd9f5e34: Status 404 returned error can't find the container with id e8be2fc252c9b4b5f76913308b6b8b792a5ce1d3184765cc1368e381bd9f5e34 Jul 23 04:45:16.749657 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.749594 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" event={"ID":"4e5eec36-2a43-4353-8abe-8862c87e5ba8","Type":"ContainerStarted","Data":"e8be2fc252c9b4b5f76913308b6b8b792a5ce1d3184765cc1368e381bd9f5e34"} Jul 23 04:45:16.893784 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.893755 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:16.932977 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.932934 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util\") pod \"47883f11-cf9a-4614-934a-02489130b790\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " Jul 23 04:45:16.932977 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.932994 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chvbd\" (UniqueName: \"kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd\") pod \"47883f11-cf9a-4614-934a-02489130b790\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " Jul 23 04:45:16.933643 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.933058 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle\") pod \"47883f11-cf9a-4614-934a-02489130b790\" (UID: \"47883f11-cf9a-4614-934a-02489130b790\") " Jul 23 04:45:16.933810 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.933770 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle" (OuterVolumeSpecName: "bundle") pod "47883f11-cf9a-4614-934a-02489130b790" (UID: "47883f11-cf9a-4614-934a-02489130b790"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:16.936159 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.936127 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd" (OuterVolumeSpecName: "kube-api-access-chvbd") pod "47883f11-cf9a-4614-934a-02489130b790" (UID: "47883f11-cf9a-4614-934a-02489130b790"). InnerVolumeSpecName "kube-api-access-chvbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:45:16.939599 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:16.939556 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util" (OuterVolumeSpecName: "util") pod "47883f11-cf9a-4614-934a-02489130b790" (UID: "47883f11-cf9a-4614-934a-02489130b790"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:17.034356 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.034277 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:17.034356 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.034310 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47883f11-cf9a-4614-934a-02489130b790-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:17.034356 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.034320 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chvbd\" (UniqueName: \"kubernetes.io/projected/47883f11-cf9a-4614-934a-02489130b790-kube-api-access-chvbd\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:17.293174 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.293019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:17.356323 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.356287 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:17.756061 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.756022 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" event={"ID":"47883f11-cf9a-4614-934a-02489130b790","Type":"ContainerDied","Data":"66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d"} Jul 23 04:45:17.756489 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.756084 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66ae4936ba6580426aa0980ac98bc85c2c7caf84c455cb1585281a8a449ea92d" Jul 23 04:45:17.756489 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:17.756033 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftw4nb" Jul 23 04:45:18.769067 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:18.769030 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" event={"ID":"4e5eec36-2a43-4353-8abe-8862c87e5ba8","Type":"ContainerStarted","Data":"7adf3471eb646493562fae81071c5754149a0cb8d4b7de51e467d758f581b081"} Jul 23 04:45:18.787277 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:18.787224 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mwzwv" podStartSLOduration=1.344840906 podStartE2EDuration="3.78720715s" totalImagesPullingTime="2.442366244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:45:18.786804834 +0000 UTC m=+372.022846154" watchObservedRunningTime="2026-07-23 04:45:18.78720715 +0000 UTC m=+372.023248405" Jul 23 04:45:22.934853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:22.934804 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:23.034764 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:23.034727 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:24.506278 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506243 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bvwrq"] Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506536 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="pull" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506549 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="pull" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506576 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="extract" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506584 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="extract" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506595 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="util" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506600 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="util" Jul 23 04:45:24.506712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.506666 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="47883f11-cf9a-4614-934a-02489130b790" containerName="extract" Jul 23 04:45:24.509610 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.509593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.511953 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.511928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hqgzm\"" Jul 23 04:45:24.520536 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.520510 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bvwrq"] Jul 23 04:45:24.600966 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.600931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm4kc\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-kube-api-access-mm4kc\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.601143 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.600978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-bound-sa-token\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.701543 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.701509 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-bound-sa-token\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.701733 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.701596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm4kc\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-kube-api-access-mm4kc\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.710944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.710906 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-bound-sa-token\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.711097 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.711016 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm4kc\" (UniqueName: \"kubernetes.io/projected/43cb4693-6030-4d52-86cf-b088e3edbae4-kube-api-access-mm4kc\") pod \"cert-manager-55b4d954d5-bvwrq\" (UID: \"43cb4693-6030-4d52-86cf-b088e3edbae4\") " pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.818443 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.818351 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bvwrq" Jul 23 04:45:24.952985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:24.952956 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bvwrq"] Jul 23 04:45:24.953551 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:24.953524 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43cb4693_6030_4d52_86cf_b088e3edbae4.slice/crio-25f54024c65fc31aa683433bca77ad7b6ce17a4af1d041d0a369248e2d02a218 WatchSource:0}: Error finding container 25f54024c65fc31aa683433bca77ad7b6ce17a4af1d041d0a369248e2d02a218: Status 404 returned error can't find the container with id 25f54024c65fc31aa683433bca77ad7b6ce17a4af1d041d0a369248e2d02a218 Jul 23 04:45:25.799862 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:25.799822 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bvwrq" event={"ID":"43cb4693-6030-4d52-86cf-b088e3edbae4","Type":"ContainerStarted","Data":"2d3f21011f362d6738b76e1847de249c0576935237cb3d16b1fdf2ae622c1171"} Jul 23 04:45:25.799862 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:25.799869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bvwrq" event={"ID":"43cb4693-6030-4d52-86cf-b088e3edbae4","Type":"ContainerStarted","Data":"25f54024c65fc31aa683433bca77ad7b6ce17a4af1d041d0a369248e2d02a218"} Jul 23 04:45:25.819306 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:25.819249 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bvwrq" podStartSLOduration=1.8192318140000001 podStartE2EDuration="1.819231814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:45:25.817236859 +0000 UTC m=+379.053278112" watchObservedRunningTime="2026-07-23 04:45:25.819231814 +0000 UTC m=+379.055273070" Jul 23 04:45:29.291090 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:29.291053 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:29.390302 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:29.390269 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:30.533755 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:30.533717 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:30.634062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:30.634023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:31.095647 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.095594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:31.392104 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.392064 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk"] Jul 23 04:45:31.413089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.413046 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk"] Jul 23 04:45:31.413245 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.413190 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.415957 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.415924 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 04:45:31.416218 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.416202 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 04:45:31.416736 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.416721 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f595s\"" Jul 23 04:45:31.463877 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.463840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.464073 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.463923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.464073 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.463952 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5d8h\" (UniqueName: \"kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.564327 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.564294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.564707 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.564337 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5d8h\" (UniqueName: \"kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.564707 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.564366 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.564707 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.564670 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.564707 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.564704 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.576818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.576793 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5d8h\" (UniqueName: \"kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.723759 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.723669 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:31.884890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:31.884778 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk"] Jul 23 04:45:32.833021 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:32.832934 2570 generic.go:356] "Generic (PLEG): container finished" podID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerID="c833ed5da03171118471a85c8ce6265e396e395016debb5daf908cc34c27f3a3" exitCode=0 Jul 23 04:45:32.833021 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:32.833005 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" event={"ID":"27d5fc88-b7fa-465c-b74d-1aab4e51f57b","Type":"ContainerDied","Data":"c833ed5da03171118471a85c8ce6265e396e395016debb5daf908cc34c27f3a3"} Jul 23 04:45:32.833432 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:32.833044 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" event={"ID":"27d5fc88-b7fa-465c-b74d-1aab4e51f57b","Type":"ContainerStarted","Data":"764bc293c347937ba210c1520f0a465ab0e5b7f99c21cb5c13a0ed812c8ed816"} Jul 23 04:45:33.839000 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:33.838962 2570 generic.go:356] "Generic (PLEG): container finished" podID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerID="f860ac7aec7e038b33aad65d93734e02ec9f248dbe556565078201b41213f3ea" exitCode=0 Jul 23 04:45:33.839398 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:33.839008 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" event={"ID":"27d5fc88-b7fa-465c-b74d-1aab4e51f57b","Type":"ContainerDied","Data":"f860ac7aec7e038b33aad65d93734e02ec9f248dbe556565078201b41213f3ea"} Jul 23 04:45:34.845985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:34.845950 2570 generic.go:356] "Generic (PLEG): container finished" podID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerID="a8f3df3ecd57529497ee3308148340f7b73168a48cd80fd10acc26ddf6db9669" exitCode=0 Jul 23 04:45:34.846407 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:34.846019 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" event={"ID":"27d5fc88-b7fa-465c-b74d-1aab4e51f57b","Type":"ContainerDied","Data":"a8f3df3ecd57529497ee3308148340f7b73168a48cd80fd10acc26ddf6db9669"} Jul 23 04:45:35.973749 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:35.973724 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:36.106032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.105929 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5d8h\" (UniqueName: \"kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h\") pod \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " Jul 23 04:45:36.106032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.105998 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util\") pod \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " Jul 23 04:45:36.106032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.106026 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle\") pod \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\" (UID: \"27d5fc88-b7fa-465c-b74d-1aab4e51f57b\") " Jul 23 04:45:36.106815 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.106783 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle" (OuterVolumeSpecName: "bundle") pod "27d5fc88-b7fa-465c-b74d-1aab4e51f57b" (UID: "27d5fc88-b7fa-465c-b74d-1aab4e51f57b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:36.108348 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.108318 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h" (OuterVolumeSpecName: "kube-api-access-b5d8h") pod "27d5fc88-b7fa-465c-b74d-1aab4e51f57b" (UID: "27d5fc88-b7fa-465c-b74d-1aab4e51f57b"). InnerVolumeSpecName "kube-api-access-b5d8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:45:36.111542 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.111503 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util" (OuterVolumeSpecName: "util") pod "27d5fc88-b7fa-465c-b74d-1aab4e51f57b" (UID: "27d5fc88-b7fa-465c-b74d-1aab4e51f57b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:45:36.207084 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.207036 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:36.207084 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.207072 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5d8h\" (UniqueName: \"kubernetes.io/projected/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-kube-api-access-b5d8h\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:36.207084 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.207082 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27d5fc88-b7fa-465c-b74d-1aab4e51f57b-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:45:36.856479 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.856449 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" Jul 23 04:45:36.856479 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.856455 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwqjsk" event={"ID":"27d5fc88-b7fa-465c-b74d-1aab4e51f57b","Type":"ContainerDied","Data":"764bc293c347937ba210c1520f0a465ab0e5b7f99c21cb5c13a0ed812c8ed816"} Jul 23 04:45:36.856716 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:36.856501 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="764bc293c347937ba210c1520f0a465ab0e5b7f99c21cb5c13a0ed812c8ed816" Jul 23 04:45:48.306174 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:48.306089 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:48.439986 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:48.439949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:48.910939 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:48.910907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.155958 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.155923 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.280586 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.280504 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.332774 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.332739 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl"] Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333044 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="pull" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333054 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="pull" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333072 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="extract" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333077 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="extract" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333084 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="util" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333089 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="util" Jul 23 04:45:49.333169 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.333144 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d5fc88-b7fa-465c-b74d-1aab4e51f57b" containerName="extract" Jul 23 04:45:49.382256 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.382225 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl"] Jul 23 04:45:49.382449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.382370 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.384955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.384926 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 04:45:49.385163 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.384926 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pzdj8\"" Jul 23 04:45:49.385460 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.385431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 04:45:49.385577 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.385496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 04:45:49.385861 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.385847 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 04:45:49.465633 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.465594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.522679 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.522643 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm"] Jul 23 04:45:49.524139 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.524114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.524252 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.524168 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wd7\" (UniqueName: \"kubernetes.io/projected/c27d2e72-75e7-4a45-9da6-90e551098894-kube-api-access-k6wd7\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.524252 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.524212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-webhook-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.524252 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.524232 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-tmp\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.524252 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.524247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-manifests\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.545786 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.545711 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm"] Jul 23 04:45:49.545918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.545813 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.548703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.548676 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 04:45:49.548843 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.548796 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 04:45:49.549113 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.549057 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 04:45:49.549177 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.549125 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8jvtk\"" Jul 23 04:45:49.549229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.549193 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 04:45:49.549514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.549497 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 04:45:49.574397 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.574364 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.625307 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625264 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wd7\" (UniqueName: \"kubernetes.io/projected/c27d2e72-75e7-4a45-9da6-90e551098894-kube-api-access-k6wd7\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.625519 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-webhook-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.625519 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625351 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-tmp\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.625519 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-manifests\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.625724 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.625858 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.625840 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-manifests\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.627935 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.627907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c27d2e72-75e7-4a45-9da6-90e551098894-tmp\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.628051 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.628024 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.628108 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.628093 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c27d2e72-75e7-4a45-9da6-90e551098894-webhook-cert\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.636671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.636646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wd7\" (UniqueName: \"kubernetes.io/projected/c27d2e72-75e7-4a45-9da6-90e551098894-kube-api-access-k6wd7\") pod \"opendatahub-operator-controller-manager-6576c599b-vbpsl\" (UID: \"c27d2e72-75e7-4a45-9da6-90e551098894\") " pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.677573 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.677540 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.693142 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.693113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:49.726832 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.726799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-metrics-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.726832 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.726838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcsn\" (UniqueName: \"kubernetes.io/projected/c3802b4c-a474-4019-9bfc-05887c9b9768-kube-api-access-ghcsn\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.727011 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.726858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3802b4c-a474-4019-9bfc-05887c9b9768-manager-config\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.727011 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.726878 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.771066 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.771032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.828192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.828098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-metrics-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.828192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.828139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcsn\" (UniqueName: \"kubernetes.io/projected/c3802b4c-a474-4019-9bfc-05887c9b9768-kube-api-access-ghcsn\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.828192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.828159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3802b4c-a474-4019-9bfc-05887c9b9768-manager-config\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.828192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.828179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.828860 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.828834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3802b4c-a474-4019-9bfc-05887c9b9768-manager-config\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.830833 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.830811 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.830917 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.830835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3802b4c-a474-4019-9bfc-05887c9b9768-metrics-cert\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.837259 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.837240 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl"] Jul 23 04:45:49.839963 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:49.839940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27d2e72_75e7_4a45_9da6_90e551098894.slice/crio-454e94183b52a943e98cc228fb20bcf6ac1d40e5954dd9557af2acc2d79a19a3 WatchSource:0}: Error finding container 454e94183b52a943e98cc228fb20bcf6ac1d40e5954dd9557af2acc2d79a19a3: Status 404 returned error can't find the container with id 454e94183b52a943e98cc228fb20bcf6ac1d40e5954dd9557af2acc2d79a19a3 Jul 23 04:45:49.842903 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.842883 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcsn\" (UniqueName: \"kubernetes.io/projected/c3802b4c-a474-4019-9bfc-05887c9b9768-kube-api-access-ghcsn\") pod \"lws-controller-manager-56ccd69865-brjnm\" (UID: \"c3802b4c-a474-4019-9bfc-05887c9b9768\") " pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.854779 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.854759 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:49.861809 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.861789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.917888 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.917847 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" event={"ID":"c27d2e72-75e7-4a45-9da6-90e551098894","Type":"ContainerStarted","Data":"454e94183b52a943e98cc228fb20bcf6ac1d40e5954dd9557af2acc2d79a19a3"} Jul 23 04:45:49.957171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.957128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:49.999793 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:49.999769 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm"] Jul 23 04:45:50.002117 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:45:50.002096 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3802b4c_a474_4019_9bfc_05887c9b9768.slice/crio-60470628cfee5324bb763fa165fea467d3eff2e2134a67f4706d6aefe19c2abe WatchSource:0}: Error finding container 60470628cfee5324bb763fa165fea467d3eff2e2134a67f4706d6aefe19c2abe: Status 404 returned error can't find the container with id 60470628cfee5324bb763fa165fea467d3eff2e2134a67f4706d6aefe19c2abe Jul 23 04:45:50.059505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:50.059462 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:50.163824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:50.163791 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:50.293205 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:50.293172 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:45:50.930055 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:50.929980 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" event={"ID":"c3802b4c-a474-4019-9bfc-05887c9b9768","Type":"ContainerStarted","Data":"60470628cfee5324bb763fa165fea467d3eff2e2134a67f4706d6aefe19c2abe"} Jul 23 04:45:53.948231 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:53.948188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" event={"ID":"c3802b4c-a474-4019-9bfc-05887c9b9768","Type":"ContainerStarted","Data":"8e4dfa04461df892d9d4a114179e60d1473ec4f48250fdfbec8744edde3d097a"} Jul 23 04:45:53.948779 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:53.948292 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:45:53.949775 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:53.949746 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" event={"ID":"c27d2e72-75e7-4a45-9da6-90e551098894","Type":"ContainerStarted","Data":"b0d789e465d8f642c6dd670e7526be4f5aa4d7929623e891a2c0817f012cfdaa"} Jul 23 04:45:53.967070 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:53.967011 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" podStartSLOduration=1.886296298 podStartE2EDuration="4.966992973s" totalImagesPullingTime="3.080696675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:45:53.966070352 +0000 UTC m=+407.202111608" watchObservedRunningTime="2026-07-23 04:45:53.966992973 +0000 UTC m=+407.203034230" Jul 23 04:45:54.956244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:54.956211 2570 generic.go:356] "Generic (PLEG): container finished" podID="c27d2e72-75e7-4a45-9da6-90e551098894" containerID="b0d789e465d8f642c6dd670e7526be4f5aa4d7929623e891a2c0817f012cfdaa" exitCode=0 Jul 23 04:45:54.956774 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:54.956294 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" event={"ID":"c27d2e72-75e7-4a45-9da6-90e551098894","Type":"ContainerDied","Data":"b0d789e465d8f642c6dd670e7526be4f5aa4d7929623e891a2c0817f012cfdaa"} Jul 23 04:45:55.963612 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:55.963573 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" event={"ID":"c27d2e72-75e7-4a45-9da6-90e551098894","Type":"ContainerStarted","Data":"10e9884f08f76bbe4d5d4e026779d062f1992a373c24ff5047eade5dcec038c0"} Jul 23 04:45:55.964045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:55.963679 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:45:55.987671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:45:55.987556 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" podStartSLOduration=2.275150438 podStartE2EDuration="6.98753972s" totalImagesPullingTime="3.621395096s" totalInitContainerRuntime="1.090994186s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:45:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:45:55.986564476 +0000 UTC m=+409.222605734" watchObservedRunningTime="2026-07-23 04:45:55.98753972 +0000 UTC m=+409.223581033" Jul 23 04:46:01.098114 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:01.098074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:01.196942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:01.196907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:04.958469 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:04.958440 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56ccd69865-brjnm" Jul 23 04:46:06.970574 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:06.970537 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6576c599b-vbpsl" Jul 23 04:46:09.681637 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:09.681589 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:09.858726 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:09.858695 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:10.491967 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:10.491933 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:10.591531 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:10.591501 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:10.718596 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:10.718552 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:10.871667 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:10.871637 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:11.136524 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:11.136433 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:11.260094 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:11.260058 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:17.364508 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:17.364473 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:20.533321 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:20.533271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:20.647748 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:20.647698 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:20.742514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:20.742481 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:20.858773 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:20.858668 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:20.994343 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:20.994315 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:21.840848 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:21.840811 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:21.943744 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:21.943710 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:22.106707 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:22.106602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:23.173750 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:23.173720 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:23.315901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:23.315865 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:24.553906 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:24.553832 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:28.224653 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.224560 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:28.329370 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.329331 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:28.891972 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.891942 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn"] Jul 23 04:46:28.895084 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.895069 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.898000 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.897975 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 04:46:28.898132 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.897975 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 04:46:28.898230 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.898200 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 04:46:28.898272 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.898255 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7k7l6\"" Jul 23 04:46:28.905827 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.905803 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn"] Jul 23 04:46:28.924057 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.924020 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:28.965130 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965259 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965259 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965259 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965369 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965274 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324e757d-b7aa-496c-aea7-8ac3511db89b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965369 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965325 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965369 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965461 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rmgq\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-kube-api-access-6rmgq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:28.965461 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:28.965414 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066429 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324e757d-b7aa-496c-aea7-8ac3511db89b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066472 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rmgq\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-kube-api-access-6rmgq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.066703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.066696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.067099 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.067074 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.067186 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.067128 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.067243 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.067181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.067243 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.067195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.067521 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.067494 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/324e757d-b7aa-496c-aea7-8ac3511db89b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.068988 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.068966 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.069198 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.069181 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.077586 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.077564 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rmgq\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-kube-api-access-6rmgq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.077701 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.077648 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/324e757d-b7aa-496c-aea7-8ac3511db89b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4bb6jn\" (UID: \"324e757d-b7aa-496c-aea7-8ac3511db89b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.147857 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.147749 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:29.205403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.205369 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:29.342146 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.342113 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn"] Jul 23 04:46:29.345402 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:46:29.345374 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324e757d_b7aa_496c_aea7_8ac3511db89b.slice/crio-67cf90ed34e29792d856a1c05f77619e037e3f54f82842645d9896d19f2729c1 WatchSource:0}: Error finding container 67cf90ed34e29792d856a1c05f77619e037e3f54f82842645d9896d19f2729c1: Status 404 returned error can't find the container with id 67cf90ed34e29792d856a1c05f77619e037e3f54f82842645d9896d19f2729c1 Jul 23 04:46:29.541567 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:29.541482 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:46:30.115193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:30.115156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" event={"ID":"324e757d-b7aa-496c-aea7-8ac3511db89b","Type":"ContainerStarted","Data":"67cf90ed34e29792d856a1c05f77619e037e3f54f82842645d9896d19f2729c1"} Jul 23 04:46:31.893589 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:31.893548 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:46:31.893942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:31.893649 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:46:31.893942 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:31.893681 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:46:32.126881 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:32.126841 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" event={"ID":"324e757d-b7aa-496c-aea7-8ac3511db89b","Type":"ContainerStarted","Data":"05466f227b66b9709f6c82c1711866032156fe31dc8a50f7ed67b391cbe02b27"} Jul 23 04:46:32.151432 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:32.151321 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" podStartSLOduration=1.605305585 podStartE2EDuration="4.151303845s" totalImagesPullingTime="2.54599826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:46:32.149101439 +0000 UTC m=+445.385142709" watchObservedRunningTime="2026-07-23 04:46:32.151303845 +0000 UTC m=+445.387345101" Jul 23 04:46:32.206041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:32.205994 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:32.207333 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:32.207305 2570 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 23 04:46:32.207456 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:32.207355 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" podUID="324e757d-b7aa-496c-aea7-8ac3511db89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 23 04:46:33.210195 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:33.210163 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:34.136661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:34.136611 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:46:34.137575 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:46:34.137555 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4bb6jn" Jul 23 04:47:11.258959 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.258920 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:11.355893 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.355854 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:11.403918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.403872 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:11.414433 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.414398 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:11.417950 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.417724 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wkspx\"" Jul 23 04:47:11.418111 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.418066 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:11.418444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.418421 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 04:47:11.418588 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.418458 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 04:47:11.467225 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.467191 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:11.535229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.535138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhpm\" (UniqueName: \"kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm\") pod \"kuadrant-operator-catalog-5mbg4\" (UID: \"9f2aa34e-7704-43ba-9340-424fa19c662d\") " pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:11.636220 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.636181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhpm\" (UniqueName: \"kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm\") pod \"kuadrant-operator-catalog-5mbg4\" (UID: \"9f2aa34e-7704-43ba-9340-424fa19c662d\") " pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:11.649053 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.649022 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhpm\" (UniqueName: \"kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm\") pod \"kuadrant-operator-catalog-5mbg4\" (UID: \"9f2aa34e-7704-43ba-9340-424fa19c662d\") " pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:11.726916 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.726881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:11.758151 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.758112 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:11.863889 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.863865 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:11.865734 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:11.865694 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2aa34e_7704_43ba_9340_424fa19c662d.slice/crio-a807841822b5c13511ee4393c20e090d6e429e552c54c87a9e766aa65a95bfe2 WatchSource:0}: Error finding container a807841822b5c13511ee4393c20e090d6e429e552c54c87a9e766aa65a95bfe2: Status 404 returned error can't find the container with id a807841822b5c13511ee4393c20e090d6e429e552c54c87a9e766aa65a95bfe2 Jul 23 04:47:11.968948 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.968905 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t94k5"] Jul 23 04:47:11.974359 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.974332 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:11.982233 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:11.982208 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t94k5"] Jul 23 04:47:12.039757 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.039721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzw5\" (UniqueName: \"kubernetes.io/projected/17c0098a-d795-4dd8-b7ec-27a1b68e3264-kube-api-access-mkzw5\") pod \"kuadrant-operator-catalog-t94k5\" (UID: \"17c0098a-d795-4dd8-b7ec-27a1b68e3264\") " pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:12.141251 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.141209 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzw5\" (UniqueName: \"kubernetes.io/projected/17c0098a-d795-4dd8-b7ec-27a1b68e3264-kube-api-access-mkzw5\") pod \"kuadrant-operator-catalog-t94k5\" (UID: \"17c0098a-d795-4dd8-b7ec-27a1b68e3264\") " pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:12.150525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.150495 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzw5\" (UniqueName: \"kubernetes.io/projected/17c0098a-d795-4dd8-b7ec-27a1b68e3264-kube-api-access-mkzw5\") pod \"kuadrant-operator-catalog-t94k5\" (UID: \"17c0098a-d795-4dd8-b7ec-27a1b68e3264\") " pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:12.284484 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.284446 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:12.315663 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.315614 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" event={"ID":"9f2aa34e-7704-43ba-9340-424fa19c662d","Type":"ContainerStarted","Data":"a807841822b5c13511ee4393c20e090d6e429e552c54c87a9e766aa65a95bfe2"} Jul 23 04:47:12.435519 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:12.435479 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t94k5"] Jul 23 04:47:12.509389 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:12.509355 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c0098a_d795_4dd8_b7ec_27a1b68e3264.slice/crio-6f73de906f186ee8c94d2895987145ef59d3980510b11f00d97206a8bdcbce8f WatchSource:0}: Error finding container 6f73de906f186ee8c94d2895987145ef59d3980510b11f00d97206a8bdcbce8f: Status 404 returned error can't find the container with id 6f73de906f186ee8c94d2895987145ef59d3980510b11f00d97206a8bdcbce8f Jul 23 04:47:13.322199 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:13.322157 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" event={"ID":"17c0098a-d795-4dd8-b7ec-27a1b68e3264","Type":"ContainerStarted","Data":"6f73de906f186ee8c94d2895987145ef59d3980510b11f00d97206a8bdcbce8f"} Jul 23 04:47:14.328998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.328893 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" event={"ID":"9f2aa34e-7704-43ba-9340-424fa19c662d","Type":"ContainerStarted","Data":"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400"} Jul 23 04:47:14.328998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.328949 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" podUID="9f2aa34e-7704-43ba-9340-424fa19c662d" containerName="registry-server" containerID="cri-o://73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400" gracePeriod=2 Jul 23 04:47:14.330611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.330568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" event={"ID":"17c0098a-d795-4dd8-b7ec-27a1b68e3264","Type":"ContainerStarted","Data":"62b73f341f43d97de92f0586ce6fc382ebdc779fdcac091b802145201b0d0729"} Jul 23 04:47:14.347311 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.347265 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" podStartSLOduration=1.326741867 podStartE2EDuration="3.347246136s" totalImagesPullingTime="2.020504269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:14.346846772 +0000 UTC m=+487.582888030" watchObservedRunningTime="2026-07-23 04:47:14.347246136 +0000 UTC m=+487.583287392" Jul 23 04:47:14.363602 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.363500 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" podStartSLOduration=1.98370051 podStartE2EDuration="3.363479661s" totalImagesPullingTime="1.379779151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:14.362857081 +0000 UTC m=+487.598898339" watchObservedRunningTime="2026-07-23 04:47:14.363479661 +0000 UTC m=+487.599520919" Jul 23 04:47:14.596630 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.596587 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:14.666090 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.666056 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jhpm\" (UniqueName: \"kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm\") pod \"9f2aa34e-7704-43ba-9340-424fa19c662d\" (UID: \"9f2aa34e-7704-43ba-9340-424fa19c662d\") " Jul 23 04:47:14.668361 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.668328 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm" (OuterVolumeSpecName: "kube-api-access-6jhpm") pod "9f2aa34e-7704-43ba-9340-424fa19c662d" (UID: "9f2aa34e-7704-43ba-9340-424fa19c662d"). InnerVolumeSpecName "kube-api-access-6jhpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:47:14.767564 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:14.767522 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jhpm\" (UniqueName: \"kubernetes.io/projected/9f2aa34e-7704-43ba-9340-424fa19c662d-kube-api-access-6jhpm\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:15.336201 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.336167 2570 generic.go:356] "Generic (PLEG): container finished" podID="9f2aa34e-7704-43ba-9340-424fa19c662d" containerID="73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400" exitCode=0 Jul 23 04:47:15.336703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.336211 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" Jul 23 04:47:15.336703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.336248 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" event={"ID":"9f2aa34e-7704-43ba-9340-424fa19c662d","Type":"ContainerDied","Data":"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400"} Jul 23 04:47:15.336703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.336301 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mbg4" event={"ID":"9f2aa34e-7704-43ba-9340-424fa19c662d","Type":"ContainerDied","Data":"a807841822b5c13511ee4393c20e090d6e429e552c54c87a9e766aa65a95bfe2"} Jul 23 04:47:15.336703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.336332 2570 scope.go:117] "RemoveContainer" containerID="73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400" Jul 23 04:47:15.345854 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.345837 2570 scope.go:117] "RemoveContainer" containerID="73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400" Jul 23 04:47:15.346118 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:47:15.346097 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400\": container with ID starting with 73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400 not found: ID does not exist" containerID="73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400" Jul 23 04:47:15.346228 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.346125 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400"} err="failed to get container status \"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400\": rpc error: code = NotFound desc = could not find container \"73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400\": container with ID starting with 73ae92f7777fd1c2fde1b99c7c590397ebfb375d8056b1f4d158ba896de0e400 not found: ID does not exist" Jul 23 04:47:15.353742 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.353711 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:15.357013 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:15.356990 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mbg4"] Jul 23 04:47:17.178740 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:17.178705 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2aa34e-7704-43ba-9340-424fa19c662d" path="/var/lib/kubelet/pods/9f2aa34e-7704-43ba-9340-424fa19c662d/volumes" Jul 23 04:47:22.284955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:22.284911 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:22.285463 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:22.285004 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:22.307864 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:22.307835 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:22.392653 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:22.392608 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t94k5" Jul 23 04:47:26.813681 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.813646 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx"] Jul 23 04:47:26.814063 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.813967 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2aa34e-7704-43ba-9340-424fa19c662d" containerName="registry-server" Jul 23 04:47:26.814063 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.813977 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2aa34e-7704-43ba-9340-424fa19c662d" containerName="registry-server" Jul 23 04:47:26.814063 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.814041 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2aa34e-7704-43ba-9340-424fa19c662d" containerName="registry-server" Jul 23 04:47:26.818480 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.818458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:26.820804 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.820776 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-27kbg\"" Jul 23 04:47:26.826636 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.826593 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx"] Jul 23 04:47:26.972332 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.972298 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:26.972505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.972349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhxx4\" (UniqueName: \"kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:26.972505 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:26.972391 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.073578 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.073486 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.073578 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.073558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.073780 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.073601 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhxx4\" (UniqueName: \"kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.073987 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.073961 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.074023 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.073971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.084549 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.084515 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhxx4\" (UniqueName: \"kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.128206 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.128164 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:27.254476 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.252081 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt"] Jul 23 04:47:27.260514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.260487 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.265403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.265376 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt"] Jul 23 04:47:27.287722 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.287491 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx"] Jul 23 04:47:27.290405 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:27.290376 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fa78a2_2499_44f9_8521_b16f326137f9.slice/crio-dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd WatchSource:0}: Error finding container dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd: Status 404 returned error can't find the container with id dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd Jul 23 04:47:27.376728 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.376690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.376911 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.376739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.377031 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.376953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spr2v\" (UniqueName: \"kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.396212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.396174 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerStarted","Data":"3efd28da1e8f901a020fdd7722c8f33ce6f077544a766cbe1343713d19804dc9"} Jul 23 04:47:27.396340 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.396234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerStarted","Data":"dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd"} Jul 23 04:47:27.477991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.477951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.477991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.477991 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.478232 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.478055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spr2v\" (UniqueName: \"kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.478414 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.478389 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.478414 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.478405 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.489920 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.489891 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spr2v\" (UniqueName: \"kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.573663 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.573599 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:27.718240 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.718206 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4"] Jul 23 04:47:27.722944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.722913 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.728083 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.728053 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt"] Jul 23 04:47:27.730472 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:27.730446 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cf5587_adb2_47b4_b356_4e6591f226b0.slice/crio-8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4 WatchSource:0}: Error finding container 8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4: Status 404 returned error can't find the container with id 8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4 Jul 23 04:47:27.757053 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.757011 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4"] Jul 23 04:47:27.882004 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.881963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.882401 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.882018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.882401 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.882096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvh8t\" (UniqueName: \"kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.983037 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.982997 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.983223 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.983049 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.983223 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.983077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvh8t\" (UniqueName: \"kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.983428 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.983408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:27.983470 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:27.983416 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:28.021874 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.021839 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvh8t\" (UniqueName: \"kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:28.034701 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.034669 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:28.135712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.135671 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r"] Jul 23 04:47:28.140570 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.140540 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.156918 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.156889 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r"] Jul 23 04:47:28.193346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.193320 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4"] Jul 23 04:47:28.195572 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:28.195536 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878cfae5_330d_455a_8a89_186db0a65749.slice/crio-cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31 WatchSource:0}: Error finding container cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31: Status 404 returned error can't find the container with id cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31 Jul 23 04:47:28.285903 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.285860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.286052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.286025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.286111 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.286051 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.386772 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.386735 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.386772 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.386775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.386977 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.386830 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.387139 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.387120 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.387174 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.387158 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.399303 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.399267 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.403534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.403505 2570 generic.go:356] "Generic (PLEG): container finished" podID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerID="1e8ae7597c28b934a86fc73b6680a90e1c4e313fcb438c69bd034f1e1591e611" exitCode=0 Jul 23 04:47:28.403671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.403583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" event={"ID":"87cf5587-adb2-47b4-b356-4e6591f226b0","Type":"ContainerDied","Data":"1e8ae7597c28b934a86fc73b6680a90e1c4e313fcb438c69bd034f1e1591e611"} Jul 23 04:47:28.403671 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.403667 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" event={"ID":"87cf5587-adb2-47b4-b356-4e6591f226b0","Type":"ContainerStarted","Data":"8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4"} Jul 23 04:47:28.405812 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.405712 2570 generic.go:356] "Generic (PLEG): container finished" podID="71fa78a2-2499-44f9-8521-b16f326137f9" containerID="3efd28da1e8f901a020fdd7722c8f33ce6f077544a766cbe1343713d19804dc9" exitCode=0 Jul 23 04:47:28.405812 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.405746 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerDied","Data":"3efd28da1e8f901a020fdd7722c8f33ce6f077544a766cbe1343713d19804dc9"} Jul 23 04:47:28.408491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.408387 2570 generic.go:356] "Generic (PLEG): container finished" podID="878cfae5-330d-455a-8a89-186db0a65749" containerID="5a267429447f55b58ee74e6de9ecaa19f62c02ba1ae79a408cace202efd376e4" exitCode=0 Jul 23 04:47:28.408491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.408469 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" event={"ID":"878cfae5-330d-455a-8a89-186db0a65749","Type":"ContainerDied","Data":"5a267429447f55b58ee74e6de9ecaa19f62c02ba1ae79a408cace202efd376e4"} Jul 23 04:47:28.408639 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.408506 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" event={"ID":"878cfae5-330d-455a-8a89-186db0a65749","Type":"ContainerStarted","Data":"cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31"} Jul 23 04:47:28.451248 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.451219 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:28.619793 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.619743 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r"] Jul 23 04:47:28.633462 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.633437 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9b785b84-k99tk"] Jul 23 04:47:28.637374 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.637318 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.651928 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.651902 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9b785b84-k99tk"] Jul 23 04:47:28.732930 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.732891 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:28.791014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.790979 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-oauth-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-service-ca\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791079 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-trusted-ca-bundle\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-oauth-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791131 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfxfq\" (UniqueName: \"kubernetes.io/projected/50176397-4f3a-4eec-9211-b47fdc356510-kube-api-access-vfxfq\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791389 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.791389 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.791298 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-console-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.833913 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.833857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:28.892013 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.891928 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-console-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892013 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.891981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-oauth-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.892021 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-service-ca\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.892046 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-trusted-ca-bundle\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.892069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-oauth-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.892096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxfq\" (UniqueName: \"kubernetes.io/projected/50176397-4f3a-4eec-9211-b47fdc356510-kube-api-access-vfxfq\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.892513 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.892211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.893149 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.893079 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-console-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.893265 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.893156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-oauth-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.893265 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.893236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-trusted-ca-bundle\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.893343 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.893285 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50176397-4f3a-4eec-9211-b47fdc356510-service-ca\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.895105 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.895073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-serving-cert\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.895105 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.895082 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50176397-4f3a-4eec-9211-b47fdc356510-console-oauth-config\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.901592 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.901569 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfxfq\" (UniqueName: \"kubernetes.io/projected/50176397-4f3a-4eec-9211-b47fdc356510-kube-api-access-vfxfq\") pod \"console-7c9b785b84-k99tk\" (UID: \"50176397-4f3a-4eec-9211-b47fdc356510\") " pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:28.965438 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:28.965401 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:29.410119 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.410005 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:29.419096 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.419061 2570 generic.go:356] "Generic (PLEG): container finished" podID="681f9037-d4a4-42b2-b537-c27a02d51393" containerID="fd14de5dcecd5312290986d0f704c8ef90a4b2b6bddf0ba83b0491cb82864f8f" exitCode=0 Jul 23 04:47:29.419231 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.419220 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" event={"ID":"681f9037-d4a4-42b2-b537-c27a02d51393","Type":"ContainerDied","Data":"fd14de5dcecd5312290986d0f704c8ef90a4b2b6bddf0ba83b0491cb82864f8f"} Jul 23 04:47:29.419337 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.419263 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" event={"ID":"681f9037-d4a4-42b2-b537-c27a02d51393","Type":"ContainerStarted","Data":"2aefdac706c173e2d4c2d496f5cf53b890115f4655e5d6632657dcc5203d3a9e"} Jul 23 04:47:29.483325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.483298 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9b785b84-k99tk"] Jul 23 04:47:29.499405 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:29.499367 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:29.569481 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:29.569446 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50176397_4f3a_4eec_9211_b47fdc356510.slice/crio-dd5901881e362aa266707ca6f75987f5d95d84f9541d4bb7fed189118e8cbde6 WatchSource:0}: Error finding container dd5901881e362aa266707ca6f75987f5d95d84f9541d4bb7fed189118e8cbde6: Status 404 returned error can't find the container with id dd5901881e362aa266707ca6f75987f5d95d84f9541d4bb7fed189118e8cbde6 Jul 23 04:47:30.425829 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.425792 2570 generic.go:356] "Generic (PLEG): container finished" podID="681f9037-d4a4-42b2-b537-c27a02d51393" containerID="01c84d0ce2f4e3480d7267ccfba1e64a91c371a96ac550cf7b682fcaa19c730f" exitCode=0 Jul 23 04:47:30.426293 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.425881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" event={"ID":"681f9037-d4a4-42b2-b537-c27a02d51393","Type":"ContainerDied","Data":"01c84d0ce2f4e3480d7267ccfba1e64a91c371a96ac550cf7b682fcaa19c730f"} Jul 23 04:47:30.427524 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.427501 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9b785b84-k99tk" event={"ID":"50176397-4f3a-4eec-9211-b47fdc356510","Type":"ContainerStarted","Data":"db23677e3407588f717acc52e01faaa1964d6c0320a23ed567d903345c400393"} Jul 23 04:47:30.427581 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.427568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9b785b84-k99tk" event={"ID":"50176397-4f3a-4eec-9211-b47fdc356510","Type":"ContainerStarted","Data":"dd5901881e362aa266707ca6f75987f5d95d84f9541d4bb7fed189118e8cbde6"} Jul 23 04:47:30.429318 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.429298 2570 generic.go:356] "Generic (PLEG): container finished" podID="71fa78a2-2499-44f9-8521-b16f326137f9" containerID="757acec674ca79a91093e94f8b6e2ae1d691c51613c54958fc1167c16119d731" exitCode=0 Jul 23 04:47:30.429418 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.429362 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerDied","Data":"757acec674ca79a91093e94f8b6e2ae1d691c51613c54958fc1167c16119d731"} Jul 23 04:47:30.431229 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.431194 2570 generic.go:356] "Generic (PLEG): container finished" podID="878cfae5-330d-455a-8a89-186db0a65749" containerID="77882684537a15f127f050ed28040b6e11ded5344e831cdd105aaa5eb0410501" exitCode=0 Jul 23 04:47:30.431485 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.431409 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" event={"ID":"878cfae5-330d-455a-8a89-186db0a65749","Type":"ContainerDied","Data":"77882684537a15f127f050ed28040b6e11ded5344e831cdd105aaa5eb0410501"} Jul 23 04:47:30.433574 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.433549 2570 generic.go:356] "Generic (PLEG): container finished" podID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerID="eed742d04cebd9e14f8668191dd954eeb02f72eb9c51265181d37fb96317e269" exitCode=0 Jul 23 04:47:30.433692 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.433584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" event={"ID":"87cf5587-adb2-47b4-b356-4e6591f226b0","Type":"ContainerDied","Data":"eed742d04cebd9e14f8668191dd954eeb02f72eb9c51265181d37fb96317e269"} Jul 23 04:47:30.549172 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:30.549093 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9b785b84-k99tk" podStartSLOduration=2.549070816 podStartE2EDuration="2.549070816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:30.546208332 +0000 UTC m=+503.782249588" watchObservedRunningTime="2026-07-23 04:47:30.549070816 +0000 UTC m=+503.785112074" Jul 23 04:47:31.447334 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.447302 2570 generic.go:356] "Generic (PLEG): container finished" podID="681f9037-d4a4-42b2-b537-c27a02d51393" containerID="304c8a0de84e3ab5c10045c3ca1afdb614ee6370c3c30ff735cba9ecb3f59d09" exitCode=0 Jul 23 04:47:31.447757 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.447402 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" event={"ID":"681f9037-d4a4-42b2-b537-c27a02d51393","Type":"ContainerDied","Data":"304c8a0de84e3ab5c10045c3ca1afdb614ee6370c3c30ff735cba9ecb3f59d09"} Jul 23 04:47:31.449316 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.449289 2570 generic.go:356] "Generic (PLEG): container finished" podID="71fa78a2-2499-44f9-8521-b16f326137f9" containerID="4564015667a15df57851c4557e3def4b8c5b548ec215605b09eb381e39a1f3f4" exitCode=0 Jul 23 04:47:31.449442 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.449348 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerDied","Data":"4564015667a15df57851c4557e3def4b8c5b548ec215605b09eb381e39a1f3f4"} Jul 23 04:47:31.451194 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.451174 2570 generic.go:356] "Generic (PLEG): container finished" podID="878cfae5-330d-455a-8a89-186db0a65749" containerID="c0ced835d23b5d3a0f71bc504a56f6627ad29bcf684a2ac38475af0ba4401ca5" exitCode=0 Jul 23 04:47:31.451285 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.451260 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" event={"ID":"878cfae5-330d-455a-8a89-186db0a65749","Type":"ContainerDied","Data":"c0ced835d23b5d3a0f71bc504a56f6627ad29bcf684a2ac38475af0ba4401ca5"} Jul 23 04:47:31.453047 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.453024 2570 generic.go:356] "Generic (PLEG): container finished" podID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerID="bed1d65e8e16f7d0e4dbd0a0e35bbe88410623df393c90bc75451ff0918a6f81" exitCode=0 Jul 23 04:47:31.453114 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:31.453098 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" event={"ID":"87cf5587-adb2-47b4-b356-4e6591f226b0","Type":"ContainerDied","Data":"bed1d65e8e16f7d0e4dbd0a0e35bbe88410623df393c90bc75451ff0918a6f81"} Jul 23 04:47:32.659363 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.659336 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:32.661437 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.661413 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:32.663586 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.663567 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:32.665645 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.665610 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:32.829235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829134 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util\") pod \"71fa78a2-2499-44f9-8521-b16f326137f9\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " Jul 23 04:47:32.829235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829185 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util\") pod \"87cf5587-adb2-47b4-b356-4e6591f226b0\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " Jul 23 04:47:32.829235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829215 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spr2v\" (UniqueName: \"kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v\") pod \"87cf5587-adb2-47b4-b356-4e6591f226b0\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " Jul 23 04:47:32.829235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829230 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util\") pod \"878cfae5-330d-455a-8a89-186db0a65749\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829258 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvh8t\" (UniqueName: \"kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t\") pod \"878cfae5-330d-455a-8a89-186db0a65749\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829284 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle\") pod \"681f9037-d4a4-42b2-b537-c27a02d51393\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829317 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f\") pod \"681f9037-d4a4-42b2-b537-c27a02d51393\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829362 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle\") pod \"87cf5587-adb2-47b4-b356-4e6591f226b0\" (UID: \"87cf5587-adb2-47b4-b356-4e6591f226b0\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829394 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhxx4\" (UniqueName: \"kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4\") pod \"71fa78a2-2499-44f9-8521-b16f326137f9\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829438 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util\") pod \"681f9037-d4a4-42b2-b537-c27a02d51393\" (UID: \"681f9037-d4a4-42b2-b537-c27a02d51393\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829513 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle\") pod \"878cfae5-330d-455a-8a89-186db0a65749\" (UID: \"878cfae5-330d-455a-8a89-186db0a65749\") " Jul 23 04:47:32.829563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.829544 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle\") pod \"71fa78a2-2499-44f9-8521-b16f326137f9\" (UID: \"71fa78a2-2499-44f9-8521-b16f326137f9\") " Jul 23 04:47:32.830250 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.830213 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle" (OuterVolumeSpecName: "bundle") pod "71fa78a2-2499-44f9-8521-b16f326137f9" (UID: "71fa78a2-2499-44f9-8521-b16f326137f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.830511 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.830478 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle" (OuterVolumeSpecName: "bundle") pod "681f9037-d4a4-42b2-b537-c27a02d51393" (UID: "681f9037-d4a4-42b2-b537-c27a02d51393"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.830882 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.830856 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle" (OuterVolumeSpecName: "bundle") pod "87cf5587-adb2-47b4-b356-4e6591f226b0" (UID: "87cf5587-adb2-47b4-b356-4e6591f226b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.832345 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.832139 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t" (OuterVolumeSpecName: "kube-api-access-dvh8t") pod "878cfae5-330d-455a-8a89-186db0a65749" (UID: "878cfae5-330d-455a-8a89-186db0a65749"). InnerVolumeSpecName "kube-api-access-dvh8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:47:32.832491 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.832449 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v" (OuterVolumeSpecName: "kube-api-access-spr2v") pod "87cf5587-adb2-47b4-b356-4e6591f226b0" (UID: "87cf5587-adb2-47b4-b356-4e6591f226b0"). InnerVolumeSpecName "kube-api-access-spr2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:47:32.832599 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.832492 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle" (OuterVolumeSpecName: "bundle") pod "878cfae5-330d-455a-8a89-186db0a65749" (UID: "878cfae5-330d-455a-8a89-186db0a65749"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.832880 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.832856 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4" (OuterVolumeSpecName: "kube-api-access-vhxx4") pod "71fa78a2-2499-44f9-8521-b16f326137f9" (UID: "71fa78a2-2499-44f9-8521-b16f326137f9"). InnerVolumeSpecName "kube-api-access-vhxx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:47:32.833527 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.833506 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f" (OuterVolumeSpecName: "kube-api-access-crj5f") pod "681f9037-d4a4-42b2-b537-c27a02d51393" (UID: "681f9037-d4a4-42b2-b537-c27a02d51393"). InnerVolumeSpecName "kube-api-access-crj5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:47:32.836634 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.836594 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util" (OuterVolumeSpecName: "util") pod "71fa78a2-2499-44f9-8521-b16f326137f9" (UID: "71fa78a2-2499-44f9-8521-b16f326137f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.836895 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.836875 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util" (OuterVolumeSpecName: "util") pod "87cf5587-adb2-47b4-b356-4e6591f226b0" (UID: "87cf5587-adb2-47b4-b356-4e6591f226b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.837125 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.837106 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util" (OuterVolumeSpecName: "util") pod "878cfae5-330d-455a-8a89-186db0a65749" (UID: "878cfae5-330d-455a-8a89-186db0a65749"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.838648 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.838611 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util" (OuterVolumeSpecName: "util") pod "681f9037-d4a4-42b2-b537-c27a02d51393" (UID: "681f9037-d4a4-42b2-b537-c27a02d51393"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:47:32.930446 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930414 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spr2v\" (UniqueName: \"kubernetes.io/projected/87cf5587-adb2-47b4-b356-4e6591f226b0-kube-api-access-spr2v\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930446 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930443 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930446 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930453 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvh8t\" (UniqueName: \"kubernetes.io/projected/878cfae5-330d-455a-8a89-186db0a65749-kube-api-access-dvh8t\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930462 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930470 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crj5f\" (UniqueName: \"kubernetes.io/projected/681f9037-d4a4-42b2-b537-c27a02d51393-kube-api-access-crj5f\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930481 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930489 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhxx4\" (UniqueName: \"kubernetes.io/projected/71fa78a2-2499-44f9-8521-b16f326137f9-kube-api-access-vhxx4\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930497 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/681f9037-d4a4-42b2-b537-c27a02d51393-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930505 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/878cfae5-330d-455a-8a89-186db0a65749-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930512 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930520 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fa78a2-2499-44f9-8521-b16f326137f9-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:32.930705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:32.930526 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87cf5587-adb2-47b4-b356-4e6591f226b0-util\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:47:33.467312 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.467229 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" Jul 23 04:47:33.467312 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.467234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r" event={"ID":"681f9037-d4a4-42b2-b537-c27a02d51393","Type":"ContainerDied","Data":"2aefdac706c173e2d4c2d496f5cf53b890115f4655e5d6632657dcc5203d3a9e"} Jul 23 04:47:33.467312 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.467285 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aefdac706c173e2d4c2d496f5cf53b890115f4655e5d6632657dcc5203d3a9e" Jul 23 04:47:33.469359 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.469321 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" Jul 23 04:47:33.469477 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.469321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx" event={"ID":"71fa78a2-2499-44f9-8521-b16f326137f9","Type":"ContainerDied","Data":"dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd"} Jul 23 04:47:33.469477 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.469416 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc3de84e9a23cf6b9355a1b358b3aae2a272dd92f2446f06e8f81b9a67326dcd" Jul 23 04:47:33.471822 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.471786 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" event={"ID":"878cfae5-330d-455a-8a89-186db0a65749","Type":"ContainerDied","Data":"cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31"} Jul 23 04:47:33.471955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.471824 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbc4dd60bc3fd65b0c61a2adf593de45c5593888f9b9fb1ac41c9819d9790d31" Jul 23 04:47:33.471955 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.471833 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4" Jul 23 04:47:33.474234 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.474214 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" event={"ID":"87cf5587-adb2-47b4-b356-4e6591f226b0","Type":"ContainerDied","Data":"8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4"} Jul 23 04:47:33.474320 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.474245 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cafb700e79dc4d7c55f77b3daade5140c4b7c9e44f9c38550d3132d983128a4" Jul 23 04:47:33.474320 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:33.474257 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt" Jul 23 04:47:35.385861 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:35.385824 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:36.007076 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:36.007044 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:36.475583 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:36.475545 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:38.966681 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:38.966608 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:38.967065 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:38.966729 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:38.971672 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:38.971650 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:39.322102 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322019 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw"] Jul 23 04:47:39.322355 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322344 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322357 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322370 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322376 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322384 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322389 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="pull" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322395 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="extract" Jul 23 04:47:39.322403 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322401 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322413 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322418 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322427 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322431 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322440 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322445 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322454 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="pull" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322458 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="pull" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322465 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322470 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322475 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322479 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322487 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322493 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322502 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322507 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="util" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322562 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="71fa78a2-2499-44f9-8521-b16f326137f9" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322571 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="878cfae5-330d-455a-8a89-186db0a65749" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322584 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cf5587-adb2-47b4-b356-4e6591f226b0" containerName="extract" Jul 23 04:47:39.322614 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.322593 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="681f9037-d4a4-42b2-b537-c27a02d51393" containerName="extract" Jul 23 04:47:39.327571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.327550 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:39.330188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.330168 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2lzzl\"" Jul 23 04:47:39.342718 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.342688 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw"] Jul 23 04:47:39.490207 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.490165 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhkw\" (UniqueName: \"kubernetes.io/projected/259d6262-877d-42a2-9aa8-c884c2a0dd97-kube-api-access-hjhkw\") pod \"authorino-operator-75cc8d5cb7-nvrkw\" (UID: \"259d6262-877d-42a2-9aa8-c884c2a0dd97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:39.507818 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.507793 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9b785b84-k99tk" Jul 23 04:47:39.577605 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.577509 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:47:39.590760 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.590730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhkw\" (UniqueName: \"kubernetes.io/projected/259d6262-877d-42a2-9aa8-c884c2a0dd97-kube-api-access-hjhkw\") pod \"authorino-operator-75cc8d5cb7-nvrkw\" (UID: \"259d6262-877d-42a2-9aa8-c884c2a0dd97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:39.606335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.606296 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhkw\" (UniqueName: \"kubernetes.io/projected/259d6262-877d-42a2-9aa8-c884c2a0dd97-kube-api-access-hjhkw\") pod \"authorino-operator-75cc8d5cb7-nvrkw\" (UID: \"259d6262-877d-42a2-9aa8-c884c2a0dd97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:39.638237 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.638201 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:39.759333 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.759300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:39.805638 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.805598 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw"] Jul 23 04:47:39.808223 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:39.808190 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259d6262_877d_42a2_9aa8_c884c2a0dd97.slice/crio-cee7f7458760cc7889bdb6697bc64928513f1427c063f99f64f5b3d187f87004 WatchSource:0}: Error finding container cee7f7458760cc7889bdb6697bc64928513f1427c063f99f64f5b3d187f87004: Status 404 returned error can't find the container with id cee7f7458760cc7889bdb6697bc64928513f1427c063f99f64f5b3d187f87004 Jul 23 04:47:39.871108 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.871069 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:39.976130 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:39.976097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:40.428447 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:40.428409 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:40.512945 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:40.512905 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" event={"ID":"259d6262-877d-42a2-9aa8-c884c2a0dd97","Type":"ContainerStarted","Data":"cee7f7458760cc7889bdb6697bc64928513f1427c063f99f64f5b3d187f87004"} Jul 23 04:47:42.009476 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.009424 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:42.110648 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.110557 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:42.235563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.235539 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r"] Jul 23 04:47:42.239352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.239328 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:42.241595 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.241573 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pgdcj\"" Jul 23 04:47:42.241686 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.241573 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 23 04:47:42.252499 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.252467 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r"] Jul 23 04:47:42.318085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.318050 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppfv7\" (UniqueName: \"kubernetes.io/projected/ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08-kube-api-access-ppfv7\") pod \"dns-operator-controller-manager-864dd78c4c-8qt2r\" (UID: \"ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:42.419294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.419253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppfv7\" (UniqueName: \"kubernetes.io/projected/ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08-kube-api-access-ppfv7\") pod \"dns-operator-controller-manager-864dd78c4c-8qt2r\" (UID: \"ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:42.436612 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.436567 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppfv7\" (UniqueName: \"kubernetes.io/projected/ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08-kube-api-access-ppfv7\") pod \"dns-operator-controller-manager-864dd78c4c-8qt2r\" (UID: \"ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:42.530697 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.530587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" event={"ID":"259d6262-877d-42a2-9aa8-c884c2a0dd97","Type":"ContainerStarted","Data":"974b5ae2bcf4321308cb171998c4895c211960408e4e08029193e85afcfd5275"} Jul 23 04:47:42.530863 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.530701 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:42.552937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.552893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:42.554593 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.554531 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" podStartSLOduration=1.12813326 podStartE2EDuration="3.554510974s" totalImagesPullingTime="2.426377714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:42.553536823 +0000 UTC m=+515.789578090" watchObservedRunningTime="2026-07-23 04:47:42.554510974 +0000 UTC m=+515.790552244" Jul 23 04:47:42.697880 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.697855 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r"] Jul 23 04:47:42.699647 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:42.699605 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0cb64f_e1b6_4ad5_a2e7_d4f795f21c08.slice/crio-77aa4fb2fcccae204b4f80b49ef1c4cdcee20b720af74fa6c07a1e7199c80c2b WatchSource:0}: Error finding container 77aa4fb2fcccae204b4f80b49ef1c4cdcee20b720af74fa6c07a1e7199c80c2b: Status 404 returned error can't find the container with id 77aa4fb2fcccae204b4f80b49ef1c4cdcee20b720af74fa6c07a1e7199c80c2b Jul 23 04:47:42.804157 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:42.804070 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:43.075373 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:43.075288 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:43.537951 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:43.537910 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" event={"ID":"ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08","Type":"ContainerStarted","Data":"77aa4fb2fcccae204b4f80b49ef1c4cdcee20b720af74fa6c07a1e7199c80c2b"} Jul 23 04:47:45.239197 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:45.239153 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:45.550644 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:45.550508 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" event={"ID":"ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08","Type":"ContainerStarted","Data":"f6d2011f560f9d449ffdffcc5ce400b4b16fc3695b2d5872149302fe67277ed1"} Jul 23 04:47:45.550644 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:45.550565 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:45.580984 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:45.580923 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" podStartSLOduration=1.527813733 podStartE2EDuration="3.580906036s" totalImagesPullingTime="2.053092303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:45.5788051 +0000 UTC m=+518.814846368" watchObservedRunningTime="2026-07-23 04:47:45.580906036 +0000 UTC m=+518.816947292" Jul 23 04:47:45.778991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:45.778957 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:47.750227 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:47.750190 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:49.274778 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.274738 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld"] Jul 23 04:47:49.282998 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.282969 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.285997 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.285971 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mnqmb\"" Jul 23 04:47:49.293372 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.293345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld"] Jul 23 04:47:49.381876 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.381836 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9dk\" (UniqueName: \"kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.382081 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.381953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.482430 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.482370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9dk\" (UniqueName: \"kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.482654 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.482480 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.482853 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.482835 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.492948 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.492927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9dk\" (UniqueName: \"kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.594009 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.593904 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:49.743427 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:49.743397 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld"] Jul 23 04:47:49.744810 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:47:49.744764 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b90b59_779c_4ad3_8967_70fddc59c67a.slice/crio-a92ad18f1bc6ce504ad4bd6713a77b00f8e184ed36f3587729ca85a8de5ef953 WatchSource:0}: Error finding container a92ad18f1bc6ce504ad4bd6713a77b00f8e184ed36f3587729ca85a8de5ef953: Status 404 returned error can't find the container with id a92ad18f1bc6ce504ad4bd6713a77b00f8e184ed36f3587729ca85a8de5ef953 Jul 23 04:47:50.375832 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:50.375764 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:50.477356 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:50.477319 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:50.580091 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:50.580056 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" event={"ID":"99b90b59-779c-4ad3-8967-70fddc59c67a","Type":"ContainerStarted","Data":"a92ad18f1bc6ce504ad4bd6713a77b00f8e184ed36f3587729ca85a8de5ef953"} Jul 23 04:47:50.587021 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:50.586970 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:50.685725 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:50.685602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:53.540727 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:53.540690 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nvrkw" Jul 23 04:47:54.194928 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:54.194888 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:54.296203 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:54.296166 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:55.610635 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:55.610582 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" event={"ID":"99b90b59-779c-4ad3-8967-70fddc59c67a","Type":"ContainerStarted","Data":"032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa"} Jul 23 04:47:55.611062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:55.610668 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:47:55.634770 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:55.634707 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" podStartSLOduration=1.752246771 podStartE2EDuration="6.634687993s" totalImagesPullingTime="4.882441222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:47:55.631723618 +0000 UTC m=+528.867764877" watchObservedRunningTime="2026-07-23 04:47:55.634687993 +0000 UTC m=+528.870729249" Jul 23 04:47:56.557977 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:56.557936 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8qt2r" Jul 23 04:47:57.626840 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:57.626808 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:57.738932 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:57.738854 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:58.185821 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:58.185783 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:47:58.288543 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:47:58.288508 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:01.864755 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:01.864709 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:01.976348 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:01.976313 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:04.603920 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.603874 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cd9f4d555-nlp9d" podUID="c0d45458-f8b1-4557-8004-40e1125dbd83" containerName="console" containerID="cri-o://74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65" gracePeriod=15 Jul 23 04:48:04.854057 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.853987 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:48:04.927843 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927805 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l8xk\" (UniqueName: \"kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927856 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927880 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927910 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927950 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.927981 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928041 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.928029 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle\") pod \"c0d45458-f8b1-4557-8004-40e1125dbd83\" (UID: \"c0d45458-f8b1-4557-8004-40e1125dbd83\") " Jul 23 04:48:04.928375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.928323 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:48:04.928375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.928334 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config" (OuterVolumeSpecName: "console-config") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:48:04.928483 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.928383 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:48:04.928638 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.928593 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:48:04.930364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.930341 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:48:04.930364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.930341 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk" (OuterVolumeSpecName: "kube-api-access-7l8xk") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "kube-api-access-7l8xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:48:04.930537 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:04.930519 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0d45458-f8b1-4557-8004-40e1125dbd83" (UID: "c0d45458-f8b1-4557-8004-40e1125dbd83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:48:05.029286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029248 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-trusted-ca-bundle\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029283 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l8xk\" (UniqueName: \"kubernetes.io/projected/c0d45458-f8b1-4557-8004-40e1125dbd83-kube-api-access-7l8xk\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029286 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029293 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-oauth-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029303 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-serving-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029313 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-console-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029321 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0d45458-f8b1-4557-8004-40e1125dbd83-service-ca\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.029535 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.029328 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0d45458-f8b1-4557-8004-40e1125dbd83-console-oauth-config\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:05.664534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.664499 2570 generic.go:356] "Generic (PLEG): container finished" podID="c0d45458-f8b1-4557-8004-40e1125dbd83" containerID="74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65" exitCode=0 Jul 23 04:48:05.664985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.664540 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9f4d555-nlp9d" Jul 23 04:48:05.664985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.664567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f4d555-nlp9d" event={"ID":"c0d45458-f8b1-4557-8004-40e1125dbd83","Type":"ContainerDied","Data":"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65"} Jul 23 04:48:05.664985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.664614 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9f4d555-nlp9d" event={"ID":"c0d45458-f8b1-4557-8004-40e1125dbd83","Type":"ContainerDied","Data":"bf34c939296ed9822a61ff5c685ba34996dfc6e60428e34069819b51066bee1a"} Jul 23 04:48:05.664985 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.664658 2570 scope.go:117] "RemoveContainer" containerID="74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65" Jul 23 04:48:05.674364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.674345 2570 scope.go:117] "RemoveContainer" containerID="74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65" Jul 23 04:48:05.674697 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:05.674676 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65\": container with ID starting with 74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65 not found: ID does not exist" containerID="74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65" Jul 23 04:48:05.674797 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.674707 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65"} err="failed to get container status \"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65\": rpc error: code = NotFound desc = could not find container \"74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65\": container with ID starting with 74e5920575ff6f118577fb6297527dfa18d7312c9f6c62af1d2811633cb33c65 not found: ID does not exist" Jul 23 04:48:05.684089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.684061 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:48:05.689296 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:05.689268 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd9f4d555-nlp9d"] Jul 23 04:48:06.618859 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:06.618827 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:07.179413 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:07.179379 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d45458-f8b1-4557-8004-40e1125dbd83" path="/var/lib/kubelet/pods/c0d45458-f8b1-4557-8004-40e1125dbd83/volumes" Jul 23 04:48:07.470075 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:07.469985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:08.379471 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.379431 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld"] Jul 23 04:48:08.379947 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.379610 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" containerName="manager" containerID="cri-o://032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa" gracePeriod=2 Jul 23 04:48:08.399970 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.399938 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld"] Jul 23 04:48:08.447871 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.447837 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:08.448247 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448230 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d45458-f8b1-4557-8004-40e1125dbd83" containerName="console" Jul 23 04:48:08.448342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448250 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d45458-f8b1-4557-8004-40e1125dbd83" containerName="console" Jul 23 04:48:08.448342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448270 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" containerName="manager" Jul 23 04:48:08.448342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448278 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" containerName="manager" Jul 23 04:48:08.448558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448369 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" containerName="manager" Jul 23 04:48:08.448558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.448387 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d45458-f8b1-4557-8004-40e1125dbd83" containerName="console" Jul 23 04:48:08.451521 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.451500 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.454682 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:08.454651 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" is forbidden: User \"system:node:ip-10-0-139-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-3.ec2.internal' and this object" podUID="0d7b4d16-c330-4251-8099-386972387dc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.457005 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:08.456972 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" is forbidden: User \"system:node:ip-10-0-139-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-3.ec2.internal' and this object" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:08.482030 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.482002 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:08.563182 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.563142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.563362 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.563213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvshk\" (UniqueName: \"kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.630182 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.630113 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:08.661336 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:08.661289 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" is forbidden: User \"system:node:ip-10-0-139-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-3.ec2.internal' and this object" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:08.663948 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.663924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.664059 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.663966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvshk\" (UniqueName: \"kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.664309 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.664291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.677114 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.677086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvshk\" (UniqueName: \"kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9klt4\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.691949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.691917 2570 generic.go:356] "Generic (PLEG): container finished" podID="99b90b59-779c-4ad3-8967-70fddc59c67a" containerID="032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa" exitCode=0 Jul 23 04:48:08.692109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.691977 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:08.692109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.692032 2570 scope.go:117] "RemoveContainer" containerID="032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa" Jul 23 04:48:08.694252 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:08.694223 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" is forbidden: User \"system:node:ip-10-0-139-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-3.ec2.internal' and this object" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:08.701612 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.701592 2570 scope.go:117] "RemoveContainer" containerID="032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa" Jul 23 04:48:08.701927 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:08.701903 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa\": container with ID starting with 032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa not found: ID does not exist" containerID="032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa" Jul 23 04:48:08.701983 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.701934 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa"} err="failed to get container status \"032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa\": rpc error: code = NotFound desc = could not find container \"032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa\": container with ID starting with 032f3b63309a78d055fce69a0e77db0454ace3b183ababa78ef124177cd193fa not found: ID does not exist" Jul 23 04:48:08.764418 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.764380 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs9dk\" (UniqueName: \"kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk\") pod \"99b90b59-779c-4ad3-8967-70fddc59c67a\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " Jul 23 04:48:08.764571 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.764440 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume\") pod \"99b90b59-779c-4ad3-8967-70fddc59c67a\" (UID: \"99b90b59-779c-4ad3-8967-70fddc59c67a\") " Jul 23 04:48:08.764888 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.764862 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99b90b59-779c-4ad3-8967-70fddc59c67a" (UID: "99b90b59-779c-4ad3-8967-70fddc59c67a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:48:08.766666 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.766639 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk" (OuterVolumeSpecName: "kube-api-access-bs9dk") pod "99b90b59-779c-4ad3-8967-70fddc59c67a" (UID: "99b90b59-779c-4ad3-8967-70fddc59c67a"). InnerVolumeSpecName "kube-api-access-bs9dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:48:08.779839 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.779811 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:08.865441 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.865408 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs9dk\" (UniqueName: \"kubernetes.io/projected/99b90b59-779c-4ad3-8967-70fddc59c67a-kube-api-access-bs9dk\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:08.865441 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.865436 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b90b59-779c-4ad3-8967-70fddc59c67a-extensions-socket-volume\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:08.928363 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:08.928338 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:08.930465 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:48:08.930441 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7b4d16_c330_4251_8099_386972387dc3.slice/crio-7d46906c52e60b2b866dba489235793bd4e8e1c96c3b38abe5a98a2ad142ed20 WatchSource:0}: Error finding container 7d46906c52e60b2b866dba489235793bd4e8e1c96c3b38abe5a98a2ad142ed20: Status 404 returned error can't find the container with id 7d46906c52e60b2b866dba489235793bd4e8e1c96c3b38abe5a98a2ad142ed20 Jul 23 04:48:09.002071 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:09.002038 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l75ld\" is forbidden: User \"system:node:ip-10-0-139-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-3.ec2.internal' and this object" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l75ld" Jul 23 04:48:09.178494 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:09.178412 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b90b59-779c-4ad3-8967-70fddc59c67a" path="/var/lib/kubelet/pods/99b90b59-779c-4ad3-8967-70fddc59c67a/volumes" Jul 23 04:48:09.700089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:09.700047 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" event={"ID":"0d7b4d16-c330-4251-8099-386972387dc3","Type":"ContainerStarted","Data":"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938"} Jul 23 04:48:09.700579 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:09.700118 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" event={"ID":"0d7b4d16-c330-4251-8099-386972387dc3","Type":"ContainerStarted","Data":"7d46906c52e60b2b866dba489235793bd4e8e1c96c3b38abe5a98a2ad142ed20"} Jul 23 04:48:09.700800 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:09.700781 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:09.875808 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:09.875775 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:10.003464 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:10.003357 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:10.478989 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:10.478950 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:10.579493 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:10.579446 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:13.444440 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:13.444405 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:13.510945 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:13.510903 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:18.145824 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:18.145785 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:18.326375 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:18.326321 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:20.709878 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:20.709837 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:20.742235 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:20.742180 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" podStartSLOduration=12.742165972 podStartE2EDuration="12.742165972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:48:09.74346197 +0000 UTC m=+542.979503227" watchObservedRunningTime="2026-07-23 04:48:20.742165972 +0000 UTC m=+553.978207239" Jul 23 04:48:22.120969 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:22.120935 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:22.246320 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:22.246270 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:24.347793 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.347755 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:24.348202 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.347951 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" podUID="0d7b4d16-c330-4251-8099-386972387dc3" containerName="manager" containerID="cri-o://70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938" gracePeriod=10 Jul 23 04:48:24.611796 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.611774 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:24.708268 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.708234 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvshk\" (UniqueName: \"kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk\") pod \"0d7b4d16-c330-4251-8099-386972387dc3\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " Jul 23 04:48:24.708446 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.708283 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume\") pod \"0d7b4d16-c330-4251-8099-386972387dc3\" (UID: \"0d7b4d16-c330-4251-8099-386972387dc3\") " Jul 23 04:48:24.708753 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.708730 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d7b4d16-c330-4251-8099-386972387dc3" (UID: "0d7b4d16-c330-4251-8099-386972387dc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 04:48:24.710553 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.710532 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk" (OuterVolumeSpecName: "kube-api-access-kvshk") pod "0d7b4d16-c330-4251-8099-386972387dc3" (UID: "0d7b4d16-c330-4251-8099-386972387dc3"). InnerVolumeSpecName "kube-api-access-kvshk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:48:24.783340 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.783306 2570 generic.go:356] "Generic (PLEG): container finished" podID="0d7b4d16-c330-4251-8099-386972387dc3" containerID="70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938" exitCode=0 Jul 23 04:48:24.783514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.783359 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" Jul 23 04:48:24.783514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.783392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" event={"ID":"0d7b4d16-c330-4251-8099-386972387dc3","Type":"ContainerDied","Data":"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938"} Jul 23 04:48:24.783514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.783446 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4" event={"ID":"0d7b4d16-c330-4251-8099-386972387dc3","Type":"ContainerDied","Data":"7d46906c52e60b2b866dba489235793bd4e8e1c96c3b38abe5a98a2ad142ed20"} Jul 23 04:48:24.783514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.783468 2570 scope.go:117] "RemoveContainer" containerID="70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938" Jul 23 04:48:24.793483 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.793464 2570 scope.go:117] "RemoveContainer" containerID="70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938" Jul 23 04:48:24.793826 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:24.793805 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938\": container with ID starting with 70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938 not found: ID does not exist" containerID="70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938" Jul 23 04:48:24.793901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.793837 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938"} err="failed to get container status \"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938\": rpc error: code = NotFound desc = could not find container \"70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938\": container with ID starting with 70f6edc60c01b9e3a89e5c7962018115de063710476e72cedd012046252d4938 not found: ID does not exist" Jul 23 04:48:24.809251 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.809211 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7b4d16-c330-4251-8099-386972387dc3-extensions-socket-volume\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:24.809251 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.809246 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvshk\" (UniqueName: \"kubernetes.io/projected/0d7b4d16-c330-4251-8099-386972387dc3-kube-api-access-kvshk\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:24.832045 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.832010 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:24.838825 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:24.838793 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9klt4"] Jul 23 04:48:25.178612 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:25.178572 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7b4d16-c330-4251-8099-386972387dc3" path="/var/lib/kubelet/pods/0d7b4d16-c330-4251-8099-386972387dc3/volumes" Jul 23 04:48:28.072163 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:28.072125 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:28.226277 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:28.226244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:40.910226 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.910189 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6"] Jul 23 04:48:40.910660 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.910547 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7b4d16-c330-4251-8099-386972387dc3" containerName="manager" Jul 23 04:48:40.910660 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.910562 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7b4d16-c330-4251-8099-386972387dc3" containerName="manager" Jul 23 04:48:40.910754 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.910673 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7b4d16-c330-4251-8099-386972387dc3" containerName="manager" Jul 23 04:48:40.913764 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.913746 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.916146 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.916123 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5v9j6\"" Jul 23 04:48:40.925299 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.925276 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6"] Jul 23 04:48:40.937160 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.937126 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:40.944204 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944238 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944427 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944361 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944427 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944388 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8hxz\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-kube-api-access-k8hxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944496 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944427 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944496 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944461 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:40.944556 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:40.944508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8hxz\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-kube-api-access-k8hxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045609 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045381 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045609 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045836 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045610 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045836 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045712 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.045944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045923 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.046214 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.045962 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.047682 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.047659 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.047881 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.047863 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.055339 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.055313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.055486 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.055429 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8hxz\" (UniqueName: \"kubernetes.io/projected/6c011d78-23ef-42f4-9e0c-600e865e5b6b-kube-api-access-k8hxz\") pod \"maas-default-gateway-openshift-default-56654dcf7-x2kg6\" (UID: \"6c011d78-23ef-42f4-9e0c-600e865e5b6b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.224729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.224588 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:41.401783 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.401757 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6"] Jul 23 04:48:41.403895 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:48:41.403862 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c011d78_23ef_42f4_9e0c_600e865e5b6b.slice/crio-2f5ea1a17919747658177d99e2100d787bad5bdfea110480cef9438fb3734e75 WatchSource:0}: Error finding container 2f5ea1a17919747658177d99e2100d787bad5bdfea110480cef9438fb3734e75: Status 404 returned error can't find the container with id 2f5ea1a17919747658177d99e2100d787bad5bdfea110480cef9438fb3734e75 Jul 23 04:48:41.406049 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.406006 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:48:41.406166 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.406101 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:48:41.406166 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.406145 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:48:41.494331 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.494245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:41.876003 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.875962 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" event={"ID":"6c011d78-23ef-42f4-9e0c-600e865e5b6b","Type":"ContainerStarted","Data":"b826c280651baee38129a2f1dddb7e5f8bc824d6414dc231eb95ad85018a56d5"} Jul 23 04:48:41.876212 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.876027 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" event={"ID":"6c011d78-23ef-42f4-9e0c-600e865e5b6b","Type":"ContainerStarted","Data":"2f5ea1a17919747658177d99e2100d787bad5bdfea110480cef9438fb3734e75"} Jul 23 04:48:41.902369 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:41.902312 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podStartSLOduration=1.9022977509999999 podStartE2EDuration="1.902297751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:48:41.8996794 +0000 UTC m=+575.135720659" watchObservedRunningTime="2026-07-23 04:48:41.902297751 +0000 UTC m=+575.138339007" Jul 23 04:48:42.225089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.224985 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:42.226738 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.226709 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x2kg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 23 04:48:42.226827 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.226775 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podUID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 23 04:48:42.965894 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.965855 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:42.973257 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.973230 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:42.976635 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.976594 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:42.978959 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.978936 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 04:48:42.979096 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.978938 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-27kbg\"" Jul 23 04:48:42.986785 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:42.986757 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:43.062719 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.062677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84lqs\" (UniqueName: \"kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.062938 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.062810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.071714 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.071680 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:43.084117 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.084076 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:43.152865 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.152834 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:43.163731 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.163697 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84lqs\" (UniqueName: \"kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.163889 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.163752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.164364 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.164346 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.175719 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.175684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84lqs\" (UniqueName: \"kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs\") pod \"limitador-limitador-64c94fd64f-qtm65\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.229584 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.229491 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:43.289246 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.289214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:43.435974 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.435944 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:43.437480 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:48:43.437453 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f082eb_b617_45d5_89f1_9c6429863082.slice/crio-d8f19b8741fccc79a7186a3c69bea6fc4477b350bf85e9fc73edffec141ec8a5 WatchSource:0}: Error finding container d8f19b8741fccc79a7186a3c69bea6fc4477b350bf85e9fc73edffec141ec8a5: Status 404 returned error can't find the container with id d8f19b8741fccc79a7186a3c69bea6fc4477b350bf85e9fc73edffec141ec8a5 Jul 23 04:48:43.854313 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.854280 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:43.858923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.858900 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:43.864197 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.864172 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7929q\"" Jul 23 04:48:43.878215 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.878183 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:43.887820 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.887782 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" event={"ID":"d3f082eb-b617-45d5-89f1-9c6429863082","Type":"ContainerStarted","Data":"d8f19b8741fccc79a7186a3c69bea6fc4477b350bf85e9fc73edffec141ec8a5"} Jul 23 04:48:43.888032 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.888012 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:43.888983 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.888965 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:48:43.892538 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.892502 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:43.970844 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:43.970799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsmd\" (UniqueName: \"kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd\") pod \"authorino-58cd955675-d9wp5\" (UID: \"30391ddc-bf72-4560-8571-bb87749c0a21\") " pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:44.019839 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.019804 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:44.071986 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.071948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsmd\" (UniqueName: \"kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd\") pod \"authorino-58cd955675-d9wp5\" (UID: \"30391ddc-bf72-4560-8571-bb87749c0a21\") " pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:44.081996 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.081967 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsmd\" (UniqueName: \"kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd\") pod \"authorino-58cd955675-d9wp5\" (UID: \"30391ddc-bf72-4560-8571-bb87749c0a21\") " pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:44.168928 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.168883 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:44.361476 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.361405 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:44.362981 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:48:44.362944 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30391ddc_bf72_4560_8571_bb87749c0a21.slice/crio-0bfeaab19d9da24f98cceaa3c508085d21e10c7ba136aa710a915e477e7a55e7 WatchSource:0}: Error finding container 0bfeaab19d9da24f98cceaa3c508085d21e10c7ba136aa710a915e477e7a55e7: Status 404 returned error can't find the container with id 0bfeaab19d9da24f98cceaa3c508085d21e10c7ba136aa710a915e477e7a55e7 Jul 23 04:48:44.895079 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:44.895037 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9wp5" event={"ID":"30391ddc-bf72-4560-8571-bb87749c0a21","Type":"ContainerStarted","Data":"0bfeaab19d9da24f98cceaa3c508085d21e10c7ba136aa710a915e477e7a55e7"} Jul 23 04:48:46.911322 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:46.911277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" event={"ID":"d3f082eb-b617-45d5-89f1-9c6429863082","Type":"ContainerStarted","Data":"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f"} Jul 23 04:48:46.911819 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:46.911365 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:48.826890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:48.826817 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" podStartSLOduration=4.008741194 podStartE2EDuration="6.826794347s" totalImagesPullingTime="2.818053153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:48:46.939460087 +0000 UTC m=+580.175501345" watchObservedRunningTime="2026-07-23 04:48:48.826794347 +0000 UTC m=+582.062835606" Jul 23 04:48:48.828934 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:48.828899 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:48.927693 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:48.927516 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9wp5" event={"ID":"30391ddc-bf72-4560-8571-bb87749c0a21","Type":"ContainerStarted","Data":"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14"} Jul 23 04:48:48.952832 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:48.952773 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-d9wp5" podStartSLOduration=1.6462270559999999 podStartE2EDuration="5.952756681s" totalImagesPullingTime="4.306529625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:48:48.948702983 +0000 UTC m=+582.184744237" watchObservedRunningTime="2026-07-23 04:48:48.952756681 +0000 UTC m=+582.188797989" Jul 23 04:48:49.933662 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:49.933584 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-d9wp5" podUID="30391ddc-bf72-4560-8571-bb87749c0a21" containerName="authorino" containerID="cri-o://f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14" gracePeriod=30 Jul 23 04:48:50.187328 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.187259 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:50.228982 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.228939 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrsmd\" (UniqueName: \"kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd\") pod \"30391ddc-bf72-4560-8571-bb87749c0a21\" (UID: \"30391ddc-bf72-4560-8571-bb87749c0a21\") " Jul 23 04:48:50.231181 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.231152 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd" (OuterVolumeSpecName: "kube-api-access-hrsmd") pod "30391ddc-bf72-4560-8571-bb87749c0a21" (UID: "30391ddc-bf72-4560-8571-bb87749c0a21"). InnerVolumeSpecName "kube-api-access-hrsmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:48:50.330715 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.330679 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrsmd\" (UniqueName: \"kubernetes.io/projected/30391ddc-bf72-4560-8571-bb87749c0a21-kube-api-access-hrsmd\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:50.940298 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.940265 2570 generic.go:356] "Generic (PLEG): container finished" podID="30391ddc-bf72-4560-8571-bb87749c0a21" containerID="f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14" exitCode=0 Jul 23 04:48:50.940777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.940307 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9wp5" Jul 23 04:48:50.940777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.940365 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9wp5" event={"ID":"30391ddc-bf72-4560-8571-bb87749c0a21","Type":"ContainerDied","Data":"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14"} Jul 23 04:48:50.940777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.940402 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9wp5" event={"ID":"30391ddc-bf72-4560-8571-bb87749c0a21","Type":"ContainerDied","Data":"0bfeaab19d9da24f98cceaa3c508085d21e10c7ba136aa710a915e477e7a55e7"} Jul 23 04:48:50.940777 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.940419 2570 scope.go:117] "RemoveContainer" containerID="f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14" Jul 23 04:48:50.950370 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.950349 2570 scope.go:117] "RemoveContainer" containerID="f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14" Jul 23 04:48:50.950676 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:50.950657 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14\": container with ID starting with f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14 not found: ID does not exist" containerID="f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14" Jul 23 04:48:50.950740 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.950685 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14"} err="failed to get container status \"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14\": rpc error: code = NotFound desc = could not find container \"f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14\": container with ID starting with f4a619c22719694a548aceed3f07ec26982340fa7dfc0f6f94a17ec0ccd1cb14 not found: ID does not exist" Jul 23 04:48:50.965773 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.965745 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:50.970021 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:50.969990 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9wp5"] Jul 23 04:48:51.178648 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:51.178573 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30391ddc-bf72-4560-8571-bb87749c0a21" path="/var/lib/kubelet/pods/30391ddc-bf72-4560-8571-bb87749c0a21/volumes" Jul 23 04:48:57.819747 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:57.819706 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:57.820165 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:57.819938 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" podUID="d3f082eb-b617-45d5-89f1-9c6429863082" containerName="limitador" containerID="cri-o://ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f" gracePeriod=30 Jul 23 04:48:57.820766 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:57.820678 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:58.379528 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.379462 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:58.511788 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.511754 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file\") pod \"d3f082eb-b617-45d5-89f1-9c6429863082\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " Jul 23 04:48:58.511968 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.511806 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84lqs\" (UniqueName: \"kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs\") pod \"d3f082eb-b617-45d5-89f1-9c6429863082\" (UID: \"d3f082eb-b617-45d5-89f1-9c6429863082\") " Jul 23 04:48:58.512183 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.512155 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file" (OuterVolumeSpecName: "config-file") pod "d3f082eb-b617-45d5-89f1-9c6429863082" (UID: "d3f082eb-b617-45d5-89f1-9c6429863082"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 04:48:58.514981 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.514931 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs" (OuterVolumeSpecName: "kube-api-access-84lqs") pod "d3f082eb-b617-45d5-89f1-9c6429863082" (UID: "d3f082eb-b617-45d5-89f1-9c6429863082"). InnerVolumeSpecName "kube-api-access-84lqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:48:58.612608 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.612553 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3f082eb-b617-45d5-89f1-9c6429863082-config-file\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:58.612608 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.612597 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84lqs\" (UniqueName: \"kubernetes.io/projected/d3f082eb-b617-45d5-89f1-9c6429863082-kube-api-access-84lqs\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:48:58.986944 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.986908 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3f082eb-b617-45d5-89f1-9c6429863082" containerID="ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f" exitCode=0 Jul 23 04:48:58.987449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.986969 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" Jul 23 04:48:58.987449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.987002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" event={"ID":"d3f082eb-b617-45d5-89f1-9c6429863082","Type":"ContainerDied","Data":"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f"} Jul 23 04:48:58.987449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.987082 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtm65" event={"ID":"d3f082eb-b617-45d5-89f1-9c6429863082","Type":"ContainerDied","Data":"d8f19b8741fccc79a7186a3c69bea6fc4477b350bf85e9fc73edffec141ec8a5"} Jul 23 04:48:58.987449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.987106 2570 scope.go:117] "RemoveContainer" containerID="ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f" Jul 23 04:48:58.996534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.996516 2570 scope.go:117] "RemoveContainer" containerID="ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f" Jul 23 04:48:58.996864 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:48:58.996842 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f\": container with ID starting with ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f not found: ID does not exist" containerID="ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f" Jul 23 04:48:58.996930 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:58.996873 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f"} err="failed to get container status \"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f\": rpc error: code = NotFound desc = could not find container \"ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f\": container with ID starting with ccebf37d045c29934033c29295f41d770a170d9c185b506d5592d0710d500c1f not found: ID does not exist" Jul 23 04:48:59.013396 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.013366 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:59.020710 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.020684 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtm65"] Jul 23 04:48:59.136529 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.136475 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:59.178311 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.178275 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3f082eb-b617-45d5-89f1-9c6429863082" path="/var/lib/kubelet/pods/d3f082eb-b617-45d5-89f1-9c6429863082/volumes" Jul 23 04:48:59.244851 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.244762 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:59.392585 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.392538 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:59.613770 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.613738 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2n995"] Jul 23 04:48:59.614108 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614095 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30391ddc-bf72-4560-8571-bb87749c0a21" containerName="authorino" Jul 23 04:48:59.614108 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614108 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="30391ddc-bf72-4560-8571-bb87749c0a21" containerName="authorino" Jul 23 04:48:59.614234 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614118 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f082eb-b617-45d5-89f1-9c6429863082" containerName="limitador" Jul 23 04:48:59.614234 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614124 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f082eb-b617-45d5-89f1-9c6429863082" containerName="limitador" Jul 23 04:48:59.614234 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614187 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="30391ddc-bf72-4560-8571-bb87749c0a21" containerName="authorino" Jul 23 04:48:59.614234 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.614195 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f082eb-b617-45d5-89f1-9c6429863082" containerName="limitador" Jul 23 04:48:59.617444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.617420 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.620414 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.620385 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 04:48:59.620573 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.620460 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zvtkl\"" Jul 23 04:48:59.621128 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.621109 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 04:48:59.621237 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.621128 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 04:48:59.626444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.626422 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2n995"] Jul 23 04:48:59.650787 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.650735 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:48:59.722290 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.722248 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-data\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.722472 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.722344 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gs6b\" (UniqueName: \"kubernetes.io/projected/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-kube-api-access-9gs6b\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.823717 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.823669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-data\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.823880 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.823740 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gs6b\" (UniqueName: \"kubernetes.io/projected/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-kube-api-access-9gs6b\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.824085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.824066 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-data\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.833562 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.833531 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gs6b\" (UniqueName: \"kubernetes.io/projected/75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd-kube-api-access-9gs6b\") pod \"postgres-69fb4594cf-2n995\" (UID: \"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:48:59.929485 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:48:59.929389 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:49:00.081550 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:00.081521 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2n995"] Jul 23 04:49:00.082905 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:00.082874 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e09282_a4c3_4a46_8f0c_ebf4d0fb0cfd.slice/crio-710b93d5032ad42534b747186b4b6d7c1e5dca953154a536b87518ebe192c580 WatchSource:0}: Error finding container 710b93d5032ad42534b747186b4b6d7c1e5dca953154a536b87518ebe192c580: Status 404 returned error can't find the container with id 710b93d5032ad42534b747186b4b6d7c1e5dca953154a536b87518ebe192c580 Jul 23 04:49:01.006507 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:01.006467 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" event={"ID":"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd","Type":"ContainerStarted","Data":"710b93d5032ad42534b747186b4b6d7c1e5dca953154a536b87518ebe192c580"} Jul 23 04:49:05.038333 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:05.038291 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" event={"ID":"75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd","Type":"ContainerStarted","Data":"107841e41ea53284801da62143d4d20e59e5834ca3475eecefebb25c757be633"} Jul 23 04:49:05.038852 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:05.038421 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:49:05.058381 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:05.058327 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" podStartSLOduration=1.191208759 podStartE2EDuration="6.058310847s" totalImagesPullingTime="4.867102088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:05.056955924 +0000 UTC m=+598.292997180" watchObservedRunningTime="2026-07-23 04:49:05.058310847 +0000 UTC m=+598.294352104" Jul 23 04:49:07.123414 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:07.123387 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:49:07.123895 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:07.123388 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:49:11.074906 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.074875 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2n995" Jul 23 04:49:11.406648 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.406592 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:11.668415 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.668331 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jmjvx"] Jul 23 04:49:11.674995 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.674970 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:11.677473 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.677450 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7929q\"" Jul 23 04:49:11.681782 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.681756 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jmjvx"] Jul 23 04:49:11.719532 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.719495 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:11.840014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.839964 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9td\" (UniqueName: \"kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td\") pod \"authorino-5d4b67c446-jmjvx\" (UID: \"f707b9e5-9bd5-444d-8776-4acc0a5b5681\") " pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:11.908294 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.908247 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jmjvx"] Jul 23 04:49:11.908590 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:49:11.908564 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nv9td], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jmjvx" podUID="f707b9e5-9bd5-444d-8776-4acc0a5b5681" Jul 23 04:49:11.938042 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.937944 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b86684cd6-sm2kt"] Jul 23 04:49:11.940845 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.940814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9td\" (UniqueName: \"kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td\") pod \"authorino-5d4b67c446-jmjvx\" (UID: \"f707b9e5-9bd5-444d-8776-4acc0a5b5681\") " pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:11.942157 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.942137 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:11.953160 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.953134 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b86684cd6-sm2kt"] Jul 23 04:49:11.955404 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:11.955376 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9td\" (UniqueName: \"kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td\") pod \"authorino-5d4b67c446-jmjvx\" (UID: \"f707b9e5-9bd5-444d-8776-4acc0a5b5681\") " pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:12.041480 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.041440 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85svf\" (UniqueName: \"kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf\") pod \"authorino-b86684cd6-sm2kt\" (UID: \"ec61685d-ab28-4acd-9248-99b27d72c2fe\") " pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:12.077162 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.077129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:12.084947 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.084923 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:12.126936 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.126897 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b86684cd6-sm2kt"] Jul 23 04:49:12.127200 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:49:12.127178 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-85svf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b86684cd6-sm2kt" podUID="ec61685d-ab28-4acd-9248-99b27d72c2fe" Jul 23 04:49:12.141948 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.141912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85svf\" (UniqueName: \"kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf\") pod \"authorino-b86684cd6-sm2kt\" (UID: \"ec61685d-ab28-4acd-9248-99b27d72c2fe\") " pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:12.154188 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.154162 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85svf\" (UniqueName: \"kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf\") pod \"authorino-b86684cd6-sm2kt\" (UID: \"ec61685d-ab28-4acd-9248-99b27d72c2fe\") " pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:12.164542 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.164514 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:49:12.168312 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.168288 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.170937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.170911 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 04:49:12.178238 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.178213 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:49:12.242597 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.242500 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv9td\" (UniqueName: \"kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td\") pod \"f707b9e5-9bd5-444d-8776-4acc0a5b5681\" (UID: \"f707b9e5-9bd5-444d-8776-4acc0a5b5681\") " Jul 23 04:49:12.244866 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.244836 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td" (OuterVolumeSpecName: "kube-api-access-nv9td") pod "f707b9e5-9bd5-444d-8776-4acc0a5b5681" (UID: "f707b9e5-9bd5-444d-8776-4acc0a5b5681"). InnerVolumeSpecName "kube-api-access-nv9td". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:49:12.343533 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.343495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.343729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.343544 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6lt\" (UniqueName: \"kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.343729 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.343601 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv9td\" (UniqueName: \"kubernetes.io/projected/f707b9e5-9bd5-444d-8776-4acc0a5b5681-kube-api-access-nv9td\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:49:12.444897 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.444849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.445104 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.444918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6lt\" (UniqueName: \"kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.447503 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.447472 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.459103 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.459075 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6lt\" (UniqueName: \"kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt\") pod \"authorino-557b9fbf7d-cx2mm\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.479949 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.479917 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:49:12.626537 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:12.626515 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:49:12.628609 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:12.628580 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69e25cd6_8062_4ed5_9388_15a52ee8a7e3.slice/crio-ed72b1288a4aa71b2e2e5f959e82836f4208f3e9fac2da3032bbd72d4f69f2e7 WatchSource:0}: Error finding container ed72b1288a4aa71b2e2e5f959e82836f4208f3e9fac2da3032bbd72d4f69f2e7: Status 404 returned error can't find the container with id ed72b1288a4aa71b2e2e5f959e82836f4208f3e9fac2da3032bbd72d4f69f2e7 Jul 23 04:49:13.084209 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.084177 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:13.084209 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.084184 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" event={"ID":"69e25cd6-8062-4ed5-9388-15a52ee8a7e3","Type":"ContainerStarted","Data":"ed72b1288a4aa71b2e2e5f959e82836f4208f3e9fac2da3032bbd72d4f69f2e7"} Jul 23 04:49:13.084689 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.084321 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jmjvx" Jul 23 04:49:13.105995 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.105975 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:13.133134 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.133102 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jmjvx"] Jul 23 04:49:13.138386 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.138354 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jmjvx"] Jul 23 04:49:13.179444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.179410 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f707b9e5-9bd5-444d-8776-4acc0a5b5681" path="/var/lib/kubelet/pods/f707b9e5-9bd5-444d-8776-4acc0a5b5681/volumes" Jul 23 04:49:13.254145 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.253703 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85svf\" (UniqueName: \"kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf\") pod \"ec61685d-ab28-4acd-9248-99b27d72c2fe\" (UID: \"ec61685d-ab28-4acd-9248-99b27d72c2fe\") " Jul 23 04:49:13.256296 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.256257 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf" (OuterVolumeSpecName: "kube-api-access-85svf") pod "ec61685d-ab28-4acd-9248-99b27d72c2fe" (UID: "ec61685d-ab28-4acd-9248-99b27d72c2fe"). InnerVolumeSpecName "kube-api-access-85svf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:49:13.354833 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:13.354746 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85svf\" (UniqueName: \"kubernetes.io/projected/ec61685d-ab28-4acd-9248-99b27d72c2fe-kube-api-access-85svf\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:49:14.091052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:14.091011 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" event={"ID":"69e25cd6-8062-4ed5-9388-15a52ee8a7e3","Type":"ContainerStarted","Data":"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63"} Jul 23 04:49:14.091052 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:14.091025 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b86684cd6-sm2kt" Jul 23 04:49:14.111827 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:14.111770 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" podStartSLOduration=1.655153474 podStartE2EDuration="2.111753971s" totalImagesPullingTime="456.600497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:14.109484535 +0000 UTC m=+607.345525793" watchObservedRunningTime="2026-07-23 04:49:14.111753971 +0000 UTC m=+607.347795227" Jul 23 04:49:14.134162 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:14.134129 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b86684cd6-sm2kt"] Jul 23 04:49:14.140190 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:14.140160 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b86684cd6-sm2kt"] Jul 23 04:49:15.178453 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:15.178421 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec61685d-ab28-4acd-9248-99b27d72c2fe" path="/var/lib/kubelet/pods/ec61685d-ab28-4acd-9248-99b27d72c2fe/volumes" Jul 23 04:49:19.176157 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.176118 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:19.226878 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.226841 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:19.230445 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.230426 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.236244 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.236219 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 04:49:19.236379 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.236262 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6bjl8\"" Jul 23 04:49:19.237269 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.237253 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 04:49:19.258003 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.257969 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:19.377534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.377490 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:19.412035 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.412000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbhpg\" (UniqueName: \"kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.412205 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.412083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.434352 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.434266 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:49:19.437901 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.437883 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.452068 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.452028 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:49:19.512906 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.512864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.513080 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.512985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbhpg\" (UniqueName: \"kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.515481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.515450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.517587 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.517563 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:19.522915 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.522893 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbhpg\" (UniqueName: \"kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg\") pod \"maas-controller-7bc5c99dc6-dkwt7\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.540713 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.540682 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:19.614570 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.614539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27fxq\" (UniqueName: \"kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.614743 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.614580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.695683 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.695655 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:19.698007 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:19.697978 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5d5c73_ef38_4bf0_bbe0_fc36ffbd9919.slice/crio-ffa555cc146ceb40ffc85a9773e05813f5bfd4895d765a00bcca3822a492c49a WatchSource:0}: Error finding container ffa555cc146ceb40ffc85a9773e05813f5bfd4895d765a00bcca3822a492c49a: Status 404 returned error can't find the container with id ffa555cc146ceb40ffc85a9773e05813f5bfd4895d765a00bcca3822a492c49a Jul 23 04:49:19.715460 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.715433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27fxq\" (UniqueName: \"kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.715584 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.715468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.718092 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.718072 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.730718 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.730690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27fxq\" (UniqueName: \"kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq\") pod \"maas-controller-6585c6c66d-ltmp4\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.747845 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.747812 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:19.895779 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:19.895755 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:49:19.897686 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:19.897659 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebfc82d_1c19_4e00_b344_0ee623270aa5.slice/crio-29d4fc98fcde040e11a2edfac168218af77af5ec9dd922027d6948297e1b7d71 WatchSource:0}: Error finding container 29d4fc98fcde040e11a2edfac168218af77af5ec9dd922027d6948297e1b7d71: Status 404 returned error can't find the container with id 29d4fc98fcde040e11a2edfac168218af77af5ec9dd922027d6948297e1b7d71 Jul 23 04:49:20.123069 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:20.123035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" event={"ID":"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919","Type":"ContainerStarted","Data":"ffa555cc146ceb40ffc85a9773e05813f5bfd4895d765a00bcca3822a492c49a"} Jul 23 04:49:20.124256 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:20.124224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" event={"ID":"5ebfc82d-1c19-4e00-b344-0ee623270aa5","Type":"ContainerStarted","Data":"29d4fc98fcde040e11a2edfac168218af77af5ec9dd922027d6948297e1b7d71"} Jul 23 04:49:22.519702 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:22.519661 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:22.615546 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:22.615516 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:23.147206 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.147167 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" event={"ID":"5ebfc82d-1c19-4e00-b344-0ee623270aa5","Type":"ContainerStarted","Data":"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e"} Jul 23 04:49:23.147397 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.147252 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:23.148764 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.148732 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" event={"ID":"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919","Type":"ContainerStarted","Data":"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15"} Jul 23 04:49:23.148886 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.148874 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:23.172899 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.172842 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" podStartSLOduration=1.7331777019999999 podStartE2EDuration="4.172825378s" totalImagesPullingTime="2.439647676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:23.171327895 +0000 UTC m=+616.407369151" watchObservedRunningTime="2026-07-23 04:49:23.172825378 +0000 UTC m=+616.408866634" Jul 23 04:49:23.191584 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:23.191523 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" podStartSLOduration=1.5453061780000001 podStartE2EDuration="4.19150629s" totalImagesPullingTime="2.646200112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:23.189049293 +0000 UTC m=+616.425090554" watchObservedRunningTime="2026-07-23 04:49:23.19150629 +0000 UTC m=+616.427547547" Jul 23 04:49:34.156677 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.156575 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:49:34.156677 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.156678 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:34.227377 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.227341 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:34.227588 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.227562 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" podUID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" containerName="manager" containerID="cri-o://8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15" gracePeriod=30 Jul 23 04:49:34.475640 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.475589 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:34.553048 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.553011 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert\") pod \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " Jul 23 04:49:34.553048 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.553062 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbhpg\" (UniqueName: \"kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg\") pod \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\" (UID: \"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919\") " Jul 23 04:49:34.555525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.555491 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" (UID: "dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:49:34.555658 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.555586 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg" (OuterVolumeSpecName: "kube-api-access-dbhpg") pod "dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" (UID: "dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919"). InnerVolumeSpecName "kube-api-access-dbhpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:49:34.654016 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.653976 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbhpg\" (UniqueName: \"kubernetes.io/projected/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-kube-api-access-dbhpg\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:49:34.654016 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:34.654008 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919-webhook-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:49:35.215287 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.215251 2570 generic.go:356] "Generic (PLEG): container finished" podID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" containerID="8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15" exitCode=0 Jul 23 04:49:35.216014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.215299 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" Jul 23 04:49:35.216014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.215326 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" event={"ID":"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919","Type":"ContainerDied","Data":"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15"} Jul 23 04:49:35.216014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.215382 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc5c99dc6-dkwt7" event={"ID":"dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919","Type":"ContainerDied","Data":"ffa555cc146ceb40ffc85a9773e05813f5bfd4895d765a00bcca3822a492c49a"} Jul 23 04:49:35.216014 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.215404 2570 scope.go:117] "RemoveContainer" containerID="8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15" Jul 23 04:49:35.226507 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.226484 2570 scope.go:117] "RemoveContainer" containerID="8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15" Jul 23 04:49:35.227077 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:49:35.227038 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15\": container with ID starting with 8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15 not found: ID does not exist" containerID="8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15" Jul 23 04:49:35.227193 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.227076 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15"} err="failed to get container status \"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15\": rpc error: code = NotFound desc = could not find container \"8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15\": container with ID starting with 8dc04efeafc9bf9d4280ad815cad3926dfe9052ea17b531f9afa519d6b01bb15 not found: ID does not exist" Jul 23 04:49:35.235611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.235585 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:35.240668 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:35.240643 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bc5c99dc6-dkwt7"] Jul 23 04:49:37.178613 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:37.178579 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" path="/var/lib/kubelet/pods/dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919/volumes" Jul 23 04:49:52.765270 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:52.765233 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:54.647471 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.647437 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:54.768012 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.767971 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9"] Jul 23 04:49:54.768361 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.768349 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" containerName="manager" Jul 23 04:49:54.768405 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.768363 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" containerName="manager" Jul 23 04:49:54.768440 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.768422 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc5d5c73-ef38-4bf0-bbe0-fc36ffbd9919" containerName="manager" Jul 23 04:49:54.776483 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.776455 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:54.800423 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.800384 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9"] Jul 23 04:49:54.845089 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.845049 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 23 04:49:54.942492 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.942403 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:54.947697 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.947665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vgnh\" (UniqueName: \"kubernetes.io/projected/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-kube-api-access-9vgnh\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:54.947838 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.947737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-openshift-service-ca\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:54.947897 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:54.947832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-maas-api-tls\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.049151 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.049108 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vgnh\" (UniqueName: \"kubernetes.io/projected/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-kube-api-access-9vgnh\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.049346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.049192 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-openshift-service-ca\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.049346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.049238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-maas-api-tls\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.049867 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.049847 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-openshift-service-ca\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.051897 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.051877 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-maas-api-tls\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.065351 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.065323 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vgnh\" (UniqueName: \"kubernetes.io/projected/50d4a629-3155-4fd7-9cf9-3c8b7250a1ab-kube-api-access-9vgnh\") pod \"maas-api-7b978c5b45-76rh9\" (UID: \"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab\") " pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.086384 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.086347 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:55.242593 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.242561 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9"] Jul 23 04:49:55.244585 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:55.244555 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d4a629_3155_4fd7_9cf9_3c8b7250a1ab.slice/crio-32dad866b402bef2623ba36da94e52aaeb59510b58fb7587dd2c3fedf6aed225 WatchSource:0}: Error finding container 32dad866b402bef2623ba36da94e52aaeb59510b58fb7587dd2c3fedf6aed225: Status 404 returned error can't find the container with id 32dad866b402bef2623ba36da94e52aaeb59510b58fb7587dd2c3fedf6aed225 Jul 23 04:49:55.245856 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.245835 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 04:49:55.336085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.336045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" event={"ID":"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab","Type":"ContainerStarted","Data":"32dad866b402bef2623ba36da94e52aaeb59510b58fb7587dd2c3fedf6aed225"} Jul 23 04:49:55.642675 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.642638 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:55.740125 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.740094 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:49:55.775281 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.775245 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkzll"] Jul 23 04:49:55.780751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.780730 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:55.784090 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.784068 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 23 04:49:55.793376 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.793348 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkzll"] Jul 23 04:49:55.959033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.958931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9b9h\" (UniqueName: \"kubernetes.io/projected/df5d121b-d1f3-4fd5-9166-74ac5755c592-kube-api-access-c9b9h\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:55.959033 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:55.958993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5d121b-d1f3-4fd5-9166-74ac5755c592-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.060373 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.060333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9b9h\" (UniqueName: \"kubernetes.io/projected/df5d121b-d1f3-4fd5-9166-74ac5755c592-kube-api-access-c9b9h\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.060558 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.060397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5d121b-d1f3-4fd5-9166-74ac5755c592-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.061258 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.061213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/df5d121b-d1f3-4fd5-9166-74ac5755c592-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.071143 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.071108 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9b9h\" (UniqueName: \"kubernetes.io/projected/df5d121b-d1f3-4fd5-9166-74ac5755c592-kube-api-access-c9b9h\") pod \"payload-processing-5bf47cd988-rkzll\" (UID: \"df5d121b-d1f3-4fd5-9166-74ac5755c592\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.093182 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.093143 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:56.270933 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.270903 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkzll"] Jul 23 04:49:56.271678 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:49:56.271603 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5d121b_d1f3_4fd5_9166_74ac5755c592.slice/crio-78b0ec98cc971aab3a9514ae82c0cdad0616aa7e639a8135a557b142adf4c23c WatchSource:0}: Error finding container 78b0ec98cc971aab3a9514ae82c0cdad0616aa7e639a8135a557b142adf4c23c: Status 404 returned error can't find the container with id 78b0ec98cc971aab3a9514ae82c0cdad0616aa7e639a8135a557b142adf4c23c Jul 23 04:49:56.346869 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:56.346825 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" event={"ID":"df5d121b-d1f3-4fd5-9166-74ac5755c592","Type":"ContainerStarted","Data":"78b0ec98cc971aab3a9514ae82c0cdad0616aa7e639a8135a557b142adf4c23c"} Jul 23 04:49:57.354827 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:57.354741 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" event={"ID":"50d4a629-3155-4fd7-9cf9-3c8b7250a1ab","Type":"ContainerStarted","Data":"b14105b1d030bac90157a6a16520f0c6ed5a8001272e904802cee4a66ed14ac7"} Jul 23 04:49:57.355301 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:57.354880 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:49:57.379534 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:57.379434 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" podStartSLOduration=1.761400521 podStartE2EDuration="3.379411492s" totalImagesPullingTime="1.618010971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:57.373275312 +0000 UTC m=+650.609316575" watchObservedRunningTime="2026-07-23 04:49:57.379411492 +0000 UTC m=+650.615452750" Jul 23 04:49:59.368087 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:59.368039 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" event={"ID":"df5d121b-d1f3-4fd5-9166-74ac5755c592","Type":"ContainerStarted","Data":"f60909c3fe16cbde7c4f0b137d5d5513b9be63a7aa94f2348d386f2fa44f9d9e"} Jul 23 04:49:59.368482 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:59.368132 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:49:59.391237 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:49:59.391184 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" podStartSLOduration=2.3197380069999998 podStartE2EDuration="4.391167322s" totalImagesPullingTime="2.071429315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:49:59.389282084 +0000 UTC m=+652.625323341" watchObservedRunningTime="2026-07-23 04:49:59.391167322 +0000 UTC m=+652.627208628" Jul 23 04:50:03.367409 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:03.367378 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b978c5b45-76rh9" Jul 23 04:50:04.398472 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.398434 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:04.401532 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.401501 2570 generic.go:356] "Generic (PLEG): container finished" podID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerID="b826c280651baee38129a2f1dddb7e5f8bc824d6414dc231eb95ad85018a56d5" exitCode=0 Jul 23 04:50:04.401701 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.401579 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" event={"ID":"6c011d78-23ef-42f4-9e0c-600e865e5b6b","Type":"ContainerDied","Data":"b826c280651baee38129a2f1dddb7e5f8bc824d6414dc231eb95ad85018a56d5"} Jul 23 04:50:04.402101 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.402084 2570 scope.go:117] "RemoveContainer" containerID="b826c280651baee38129a2f1dddb7e5f8bc824d6414dc231eb95ad85018a56d5" Jul 23 04:50:04.403242 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.403216 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:50:04.403299 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.403287 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:50:04.403338 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.403319 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 04:50:04.498808 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:04.498776 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:05.413163 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:05.413113 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" event={"ID":"6c011d78-23ef-42f4-9e0c-600e865e5b6b","Type":"ContainerStarted","Data":"976a1c5bac088aeb9a5382b53bbb93831e6282cb707c4b12e8268407d5266ffc"} Jul 23 04:50:06.225346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:06.225296 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:50:06.225611 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:06.225586 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x2kg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 23 04:50:06.225698 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:06.225666 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podUID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 23 04:50:07.225732 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:07.225689 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x2kg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 23 04:50:07.226121 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:07.225760 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podUID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 23 04:50:08.225251 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:08.225207 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x2kg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 23 04:50:08.225444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:08.225282 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podUID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 23 04:50:09.225439 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:09.225401 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x2kg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 23 04:50:09.225897 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:09.225465 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" podUID="6c011d78-23ef-42f4-9e0c-600e865e5b6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 23 04:50:10.229799 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:10.229767 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:50:10.230200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:10.230019 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:50:10.230796 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:10.230773 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x2kg6" Jul 23 04:50:10.375807 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:10.375777 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-rkzll" Jul 23 04:50:11.468245 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.468198 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48"] Jul 23 04:50:11.475425 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.475396 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.478794 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.478756 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 04:50:11.478928 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.478838 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f7qjs\"" Jul 23 04:50:11.479636 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.479600 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 23 04:50:11.479757 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.479607 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 04:50:11.485930 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.485890 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48"] Jul 23 04:50:11.504973 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.504939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.504973 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.504975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.505245 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.505026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.505245 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.505128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq7rf\" (UniqueName: \"kubernetes.io/projected/c1d070e3-dd6b-431c-8110-e1b3c303a204-kube-api-access-vq7rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.505336 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.505294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d070e3-dd6b-431c-8110-e1b3c303a204-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.505379 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.505332 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.505878 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.505858 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:11.606325 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d070e3-dd6b-431c-8110-e1b3c303a204-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606401 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606525 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq7rf\" (UniqueName: \"kubernetes.io/projected/c1d070e3-dd6b-431c-8110-e1b3c303a204-kube-api-access-vq7rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606908 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606877 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.606991 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.606929 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.609055 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.609031 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1d070e3-dd6b-431c-8110-e1b3c303a204-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.609171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.609153 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d070e3-dd6b-431c-8110-e1b3c303a204-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.615884 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.615856 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq7rf\" (UniqueName: \"kubernetes.io/projected/c1d070e3-dd6b-431c-8110-e1b3c303a204-kube-api-access-vq7rf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48\" (UID: \"c1d070e3-dd6b-431c-8110-e1b3c303a204\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.787559 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.787464 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:11.944022 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:11.943993 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48"] Jul 23 04:50:11.946312 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:50:11.946281 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d070e3_dd6b_431c_8110_e1b3c303a204.slice/crio-7c28c5b3344afcf1531fd7765a59a65a6bcf5e3dcb175a161fa627f32082cccc WatchSource:0}: Error finding container 7c28c5b3344afcf1531fd7765a59a65a6bcf5e3dcb175a161fa627f32082cccc: Status 404 returned error can't find the container with id 7c28c5b3344afcf1531fd7765a59a65a6bcf5e3dcb175a161fa627f32082cccc Jul 23 04:50:12.464437 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:12.464377 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" event={"ID":"c1d070e3-dd6b-431c-8110-e1b3c303a204","Type":"ContainerStarted","Data":"7c28c5b3344afcf1531fd7765a59a65a6bcf5e3dcb175a161fa627f32082cccc"} Jul 23 04:50:13.471800 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:13.471697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" event={"ID":"c1d070e3-dd6b-431c-8110-e1b3c303a204","Type":"ContainerStarted","Data":"6de2bcf43ffee266ef4e63f6ae9fd37bce41149552ce11b07210dbbb903b9d24"} Jul 23 04:50:13.490839 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:13.490782 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" podStartSLOduration=1.30369221 podStartE2EDuration="2.490766283s" totalImagesPullingTime="1.187074073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:50:13.489780749 +0000 UTC m=+666.725822006" watchObservedRunningTime="2026-07-23 04:50:13.490766283 +0000 UTC m=+666.726807540" Jul 23 04:50:21.788396 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:21.788361 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:21.788926 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:21.788546 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:21.801222 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:21.801190 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:22.532008 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:22.531971 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48" Jul 23 04:50:24.831129 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:24.831090 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:26.998227 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:26.998193 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:33.779020 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.778981 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2"] Jul 23 04:50:33.785595 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.785566 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.788910 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.788881 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 04:50:33.805036 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.805003 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2"] Jul 23 04:50:33.826672 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.826599 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:33.914321 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.914507 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914334 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.914507 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914412 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8526330d-1f19-4019-9d3f-4f9117d541bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.914507 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps656\" (UniqueName: \"kubernetes.io/projected/8526330d-1f19-4019-9d3f-4f9117d541bb-kube-api-access-ps656\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.914661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914514 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:33.914661 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:33.914545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015712 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8526330d-1f19-4019-9d3f-4f9117d541bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps656\" (UniqueName: \"kubernetes.io/projected/8526330d-1f19-4019-9d3f-4f9117d541bb-kube-api-access-ps656\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.015924 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.015903 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.016248 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.016112 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.016313 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.016248 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.016313 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.016287 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.018887 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.018849 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8526330d-1f19-4019-9d3f-4f9117d541bb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.019135 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.019113 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8526330d-1f19-4019-9d3f-4f9117d541bb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.027588 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.027558 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps656\" (UniqueName: \"kubernetes.io/projected/8526330d-1f19-4019-9d3f-4f9117d541bb-kube-api-access-ps656\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vkvt2\" (UID: \"8526330d-1f19-4019-9d3f-4f9117d541bb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.096741 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.096614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:34.243187 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.243163 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2"] Jul 23 04:50:34.246189 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:50:34.246161 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8526330d_1f19_4019_9d3f_4f9117d541bb.slice/crio-1e6a71b890cc17cd1b4c662b7abf2e83949bca98301fc30e21dabbcb06989ddb WatchSource:0}: Error finding container 1e6a71b890cc17cd1b4c662b7abf2e83949bca98301fc30e21dabbcb06989ddb: Status 404 returned error can't find the container with id 1e6a71b890cc17cd1b4c662b7abf2e83949bca98301fc30e21dabbcb06989ddb Jul 23 04:50:34.585751 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.585705 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" event={"ID":"8526330d-1f19-4019-9d3f-4f9117d541bb","Type":"ContainerStarted","Data":"6e6a60c54c0a21d1b544b797ae1987b5c7d611bc13b66fb0bc6cb93b0fe346db"} Jul 23 04:50:34.585923 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.585764 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" event={"ID":"8526330d-1f19-4019-9d3f-4f9117d541bb","Type":"ContainerStarted","Data":"1e6a71b890cc17cd1b4c662b7abf2e83949bca98301fc30e21dabbcb06989ddb"} Jul 23 04:50:34.618705 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:34.618634 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" podStartSLOduration=1.450974562 podStartE2EDuration="1.618590215s" totalImagesPullingTime="167.615653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:50:34.616230983 +0000 UTC m=+687.852272238" watchObservedRunningTime="2026-07-23 04:50:34.618590215 +0000 UTC m=+687.854631471" Jul 23 04:50:38.572680 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:38.572646 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:44.097575 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:44.097522 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:44.098034 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:44.097646 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:44.109854 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:44.109827 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:44.653590 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:44.653557 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vkvt2" Jul 23 04:50:45.522600 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:45.522568 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:50.940062 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:50.940029 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:50:59.699719 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:50:59.699556 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:12.565956 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:12.565920 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:12.663863 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:12.663829 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:13.675308 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:13.675245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:13.795503 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:13.795470 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:13.802925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:13.802891 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:52:13.803174 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:13.803127 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" podUID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" containerName="authorino" containerID="cri-o://d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63" gracePeriod=30 Jul 23 04:52:14.065745 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.065715 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:52:14.145202 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.145163 2570 generic.go:356] "Generic (PLEG): container finished" podID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" containerID="d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63" exitCode=0 Jul 23 04:52:14.145404 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.145222 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" Jul 23 04:52:14.145404 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.145226 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" event={"ID":"69e25cd6-8062-4ed5-9388-15a52ee8a7e3","Type":"ContainerDied","Data":"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63"} Jul 23 04:52:14.145404 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.145336 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557b9fbf7d-cx2mm" event={"ID":"69e25cd6-8062-4ed5-9388-15a52ee8a7e3","Type":"ContainerDied","Data":"ed72b1288a4aa71b2e2e5f959e82836f4208f3e9fac2da3032bbd72d4f69f2e7"} Jul 23 04:52:14.145404 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.145359 2570 scope.go:117] "RemoveContainer" containerID="d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63" Jul 23 04:52:14.154827 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.154801 2570 scope.go:117] "RemoveContainer" containerID="d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63" Jul 23 04:52:14.155221 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:52:14.155196 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63\": container with ID starting with d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63 not found: ID does not exist" containerID="d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63" Jul 23 04:52:14.155300 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.155233 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63"} err="failed to get container status \"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63\": rpc error: code = NotFound desc = could not find container \"d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63\": container with ID starting with d43cfff4987dfbbb00c4fcd99cb9521592460d7e7a8c2b31917bb8008822ce63 not found: ID does not exist" Jul 23 04:52:14.165514 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.165490 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert\") pod \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " Jul 23 04:52:14.165672 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.165644 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj6lt\" (UniqueName: \"kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt\") pod \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\" (UID: \"69e25cd6-8062-4ed5-9388-15a52ee8a7e3\") " Jul 23 04:52:14.167846 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.167808 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt" (OuterVolumeSpecName: "kube-api-access-kj6lt") pod "69e25cd6-8062-4ed5-9388-15a52ee8a7e3" (UID: "69e25cd6-8062-4ed5-9388-15a52ee8a7e3"). InnerVolumeSpecName "kube-api-access-kj6lt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:52:14.177208 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.177182 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "69e25cd6-8062-4ed5-9388-15a52ee8a7e3" (UID: "69e25cd6-8062-4ed5-9388-15a52ee8a7e3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:52:14.266935 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.266854 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj6lt\" (UniqueName: \"kubernetes.io/projected/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-kube-api-access-kj6lt\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:52:14.266935 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.266884 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69e25cd6-8062-4ed5-9388-15a52ee8a7e3-tls-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:52:14.486016 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.485978 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:52:14.489342 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:14.489311 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557b9fbf7d-cx2mm"] Jul 23 04:52:15.178448 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:15.178408 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" path="/var/lib/kubelet/pods/69e25cd6-8062-4ed5-9388-15a52ee8a7e3/volumes" Jul 23 04:52:45.940261 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:45.940228 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:46.041192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:46.041153 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:52:55.247795 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:52:55.247759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:53:00.000171 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.000126 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:53:00.000580 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.000338 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" podUID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" containerName="manager" containerID="cri-o://6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e" gracePeriod=30 Jul 23 04:53:00.264373 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.264305 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:53:00.399540 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.399494 2570 generic.go:356] "Generic (PLEG): container finished" podID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" containerID="6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e" exitCode=0 Jul 23 04:53:00.399540 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.399547 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" Jul 23 04:53:00.399890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.399577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" event={"ID":"5ebfc82d-1c19-4e00-b344-0ee623270aa5","Type":"ContainerDied","Data":"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e"} Jul 23 04:53:00.399890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.399653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-ltmp4" event={"ID":"5ebfc82d-1c19-4e00-b344-0ee623270aa5","Type":"ContainerDied","Data":"29d4fc98fcde040e11a2edfac168218af77af5ec9dd922027d6948297e1b7d71"} Jul 23 04:53:00.399890 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.399680 2570 scope.go:117] "RemoveContainer" containerID="6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e" Jul 23 04:53:00.400450 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.400431 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert\") pod \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " Jul 23 04:53:00.400498 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.400473 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27fxq\" (UniqueName: \"kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq\") pod \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\" (UID: \"5ebfc82d-1c19-4e00-b344-0ee623270aa5\") " Jul 23 04:53:00.402796 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.402765 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5ebfc82d-1c19-4e00-b344-0ee623270aa5" (UID: "5ebfc82d-1c19-4e00-b344-0ee623270aa5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:53:00.402796 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.402791 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq" (OuterVolumeSpecName: "kube-api-access-27fxq") pod "5ebfc82d-1c19-4e00-b344-0ee623270aa5" (UID: "5ebfc82d-1c19-4e00-b344-0ee623270aa5"). InnerVolumeSpecName "kube-api-access-27fxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:53:00.421443 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.421416 2570 scope.go:117] "RemoveContainer" containerID="6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e" Jul 23 04:53:00.421853 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:53:00.421832 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e\": container with ID starting with 6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e not found: ID does not exist" containerID="6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e" Jul 23 04:53:00.421937 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.421869 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e"} err="failed to get container status \"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e\": rpc error: code = NotFound desc = could not find container \"6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e\": container with ID starting with 6104d7d78ff0b96ba0b696ca4a3cbdf6f90c74c43c289d6e18ed014e90db2f8e not found: ID does not exist" Jul 23 04:53:00.501563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.501521 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebfc82d-1c19-4e00-b344-0ee623270aa5-webhook-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:53:00.501563 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.501555 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27fxq\" (UniqueName: \"kubernetes.io/projected/5ebfc82d-1c19-4e00-b344-0ee623270aa5-kube-api-access-27fxq\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:53:00.722774 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.722723 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:53:00.728788 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:00.728755 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-ltmp4"] Jul 23 04:53:01.179544 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:01.179509 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" path="/var/lib/kubelet/pods/5ebfc82d-1c19-4e00-b344-0ee623270aa5/volumes" Jul 23 04:53:47.373039 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:53:47.373003 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:54:01.539744 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.539654 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:01.540144 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540132 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" containerName="manager" Jul 23 04:54:01.540209 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540149 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" containerName="manager" Jul 23 04:54:01.540209 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540171 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" containerName="authorino" Jul 23 04:54:01.540209 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540177 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" containerName="authorino" Jul 23 04:54:01.540346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540264 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebfc82d-1c19-4e00-b344-0ee623270aa5" containerName="manager" Jul 23 04:54:01.540346 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.540277 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e25cd6-8062-4ed5-9388-15a52ee8a7e3" containerName="authorino" Jul 23 04:54:01.543596 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.543574 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.546085 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.546059 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 04:54:01.546805 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.546788 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 04:54:01.546917 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.546898 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6bjl8\"" Jul 23 04:54:01.554462 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.554420 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:01.571589 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.571506 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.571950 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.571926 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtfn\" (UniqueName: \"kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.672835 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.672772 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.672835 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.672845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtfn\" (UniqueName: \"kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.675449 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.675425 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.682975 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.682946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtfn\" (UniqueName: \"kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn\") pod \"maas-controller-6585c6c66d-mng96\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:01.879935 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:01.879887 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:02.030444 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:02.030414 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:02.032774 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:54:02.032746 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87404d43_aa9f_4a6b_9d8d_9b91763a4536.slice/crio-fea480c82876f8eb0372d35cd92bc64075a6b857f5f6a0777bb16e3938b9b5f7 WatchSource:0}: Error finding container fea480c82876f8eb0372d35cd92bc64075a6b857f5f6a0777bb16e3938b9b5f7: Status 404 returned error can't find the container with id fea480c82876f8eb0372d35cd92bc64075a6b857f5f6a0777bb16e3938b9b5f7 Jul 23 04:54:02.745109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:02.745002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-mng96" event={"ID":"87404d43-aa9f-4a6b-9d8d-9b91763a4536","Type":"ContainerStarted","Data":"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1"} Jul 23 04:54:02.745109 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:02.745099 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-mng96" event={"ID":"87404d43-aa9f-4a6b-9d8d-9b91763a4536","Type":"ContainerStarted","Data":"fea480c82876f8eb0372d35cd92bc64075a6b857f5f6a0777bb16e3938b9b5f7"} Jul 23 04:54:02.745532 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:02.745127 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:02.766094 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:02.766029 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6585c6c66d-mng96" podStartSLOduration=1.348978843 podStartE2EDuration="1.766009778s" totalImagesPullingTime="417.030935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:54:02.764506522 +0000 UTC m=+896.000547783" watchObservedRunningTime="2026-07-23 04:54:02.766009778 +0000 UTC m=+896.002051070" Jul 23 04:54:07.160358 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:07.160328 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:54:07.162451 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:07.162422 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:54:13.753565 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:13.753525 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:18.298498 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.298461 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:54:18.406591 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.406543 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:18.406851 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.406817 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6585c6c66d-mng96" podUID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" containerName="manager" containerID="cri-o://f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1" gracePeriod=30 Jul 23 04:54:18.659691 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.659659 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:18.732343 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.732309 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrtfn\" (UniqueName: \"kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn\") pod \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " Jul 23 04:54:18.732521 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.732355 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert\") pod \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\" (UID: \"87404d43-aa9f-4a6b-9d8d-9b91763a4536\") " Jul 23 04:54:18.734669 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.734640 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn" (OuterVolumeSpecName: "kube-api-access-xrtfn") pod "87404d43-aa9f-4a6b-9d8d-9b91763a4536" (UID: "87404d43-aa9f-4a6b-9d8d-9b91763a4536"). InnerVolumeSpecName "kube-api-access-xrtfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 04:54:18.734669 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.734656 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87404d43-aa9f-4a6b-9d8d-9b91763a4536" (UID: "87404d43-aa9f-4a6b-9d8d-9b91763a4536"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 04:54:18.833885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.833792 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrtfn\" (UniqueName: \"kubernetes.io/projected/87404d43-aa9f-4a6b-9d8d-9b91763a4536-kube-api-access-xrtfn\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:54:18.833885 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.833823 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87404d43-aa9f-4a6b-9d8d-9b91763a4536-webhook-cert\") on node \"ip-10-0-139-3.ec2.internal\" DevicePath \"\"" Jul 23 04:54:18.839743 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.839707 2570 generic.go:356] "Generic (PLEG): container finished" podID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" containerID="f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1" exitCode=0 Jul 23 04:54:18.839925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.839759 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-mng96" Jul 23 04:54:18.839925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.839790 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-mng96" event={"ID":"87404d43-aa9f-4a6b-9d8d-9b91763a4536","Type":"ContainerDied","Data":"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1"} Jul 23 04:54:18.839925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.839839 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-mng96" event={"ID":"87404d43-aa9f-4a6b-9d8d-9b91763a4536","Type":"ContainerDied","Data":"fea480c82876f8eb0372d35cd92bc64075a6b857f5f6a0777bb16e3938b9b5f7"} Jul 23 04:54:18.839925 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.839861 2570 scope.go:117] "RemoveContainer" containerID="f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1" Jul 23 04:54:18.857461 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.857438 2570 scope.go:117] "RemoveContainer" containerID="f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1" Jul 23 04:54:18.857790 ip-10-0-139-3 kubenswrapper[2570]: E0723 04:54:18.857762 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1\": container with ID starting with f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1 not found: ID does not exist" containerID="f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1" Jul 23 04:54:18.857882 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.857797 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1"} err="failed to get container status \"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1\": rpc error: code = NotFound desc = could not find container \"f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1\": container with ID starting with f9bc1a95cfe2183fcff772568c50665049c9c3beca90f73d412272de3c865da1 not found: ID does not exist" Jul 23 04:54:18.866816 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.866781 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:18.871506 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:18.871480 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-mng96"] Jul 23 04:54:19.178283 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.178249 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" path="/var/lib/kubelet/pods/87404d43-aa9f-4a6b-9d8d-9b91763a4536/volumes" Jul 23 04:54:19.569950 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.569866 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:54:19.687335 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.687296 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6585c6c66d-f92mk"] Jul 23 04:54:19.687814 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.687794 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" containerName="manager" Jul 23 04:54:19.687814 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.687815 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" containerName="manager" Jul 23 04:54:19.687966 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.687921 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="87404d43-aa9f-4a6b-9d8d-9b91763a4536" containerName="manager" Jul 23 04:54:19.692481 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.692458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.695483 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.695458 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 04:54:19.695650 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.695459 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 04:54:19.695650 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.695465 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6bjl8\"" Jul 23 04:54:19.701200 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.701177 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-f92mk"] Jul 23 04:54:19.843266 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.843161 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm5b5\" (UniqueName: \"kubernetes.io/projected/0d6716a6-d124-4dac-bbf9-19dbe9446dab-kube-api-access-vm5b5\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.843266 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.843220 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d6716a6-d124-4dac-bbf9-19dbe9446dab-webhook-cert\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.944521 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.944482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm5b5\" (UniqueName: \"kubernetes.io/projected/0d6716a6-d124-4dac-bbf9-19dbe9446dab-kube-api-access-vm5b5\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.944742 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.944563 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d6716a6-d124-4dac-bbf9-19dbe9446dab-webhook-cert\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.947357 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.947330 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d6716a6-d124-4dac-bbf9-19dbe9446dab-webhook-cert\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:19.955266 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:19.955240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm5b5\" (UniqueName: \"kubernetes.io/projected/0d6716a6-d124-4dac-bbf9-19dbe9446dab-kube-api-access-vm5b5\") pod \"maas-controller-6585c6c66d-f92mk\" (UID: \"0d6716a6-d124-4dac-bbf9-19dbe9446dab\") " pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:20.004334 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.004292 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:20.151410 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.151382 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6585c6c66d-f92mk"] Jul 23 04:54:20.153487 ip-10-0-139-3 kubenswrapper[2570]: W0723 04:54:20.153459 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6716a6_d124_4dac_bbf9_19dbe9446dab.slice/crio-8267a411f904a9dd2f6ba93eebc037407ee1177f249b1e8153cbb6d985650207 WatchSource:0}: Error finding container 8267a411f904a9dd2f6ba93eebc037407ee1177f249b1e8153cbb6d985650207: Status 404 returned error can't find the container with id 8267a411f904a9dd2f6ba93eebc037407ee1177f249b1e8153cbb6d985650207 Jul 23 04:54:20.853684 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.853575 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-f92mk" event={"ID":"0d6716a6-d124-4dac-bbf9-19dbe9446dab","Type":"ContainerStarted","Data":"b2cd8ef18bc5c2eeb5f0fe060b854f508229d516b6b620f64cfbde1d7d5bd13e"} Jul 23 04:54:20.854264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.853767 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:54:20.854264 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.853798 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6585c6c66d-f92mk" event={"ID":"0d6716a6-d124-4dac-bbf9-19dbe9446dab","Type":"ContainerStarted","Data":"8267a411f904a9dd2f6ba93eebc037407ee1177f249b1e8153cbb6d985650207"} Jul 23 04:54:20.875664 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:20.875589 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6585c6c66d-f92mk" podStartSLOduration=1.513636924 podStartE2EDuration="1.875570894s" totalImagesPullingTime="361.93397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 04:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 04:54:20.872764671 +0000 UTC m=+914.108805940" watchObservedRunningTime="2026-07-23 04:54:20.875570894 +0000 UTC m=+914.111612175" Jul 23 04:54:31.862769 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:54:31.862732 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6585c6c66d-f92mk" Jul 23 04:55:00.464849 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:00.464802 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:01.810762 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:01.810720 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:06.997211 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:06.997170 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:07.102703 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:07.102667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:07.198073 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:07.198036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:07.360192 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:07.360162 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:13.836217 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:13.836179 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:55:13.918064 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:55:13.918029 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:56:29.040093 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:56:29.040053 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:56:29.143844 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:56:29.143803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:57:31.437319 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:57:31.437282 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:59:01.346843 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:01.346755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:59:01.446590 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:01.446540 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:59:07.196260 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:07.196219 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:59:07.200588 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:07.200566 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 04:59:38.334277 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:38.334236 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 04:59:38.430184 ip-10-0-139-3 kubenswrapper[2570]: I0723 04:59:38.430145 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:02:20.877296 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:02:20.877260 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:02:39.632061 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:02:39.632024 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:02:56.527111 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:02:56.527074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:03:52.903670 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:03:52.903604 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:03:53.955607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:03:53.955569 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:04:07.232961 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:04:07.232934 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 05:04:07.238758 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:04:07.238736 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 05:04:56.422193 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:04:56.422160 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:06:04.646572 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:06:04.646536 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:07:16.783190 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:16.783155 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6585c6c66d-f92mk_0d6716a6-d124-4dac-bbf9-19dbe9446dab/manager/0.log" Jul 23 05:07:17.397776 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:17.397747 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6576c599b-vbpsl_c27d2e72-75e7-4a45-9da6-90e551098894/copy-manifests/0.log" Jul 23 05:07:17.404752 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:17.404726 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6576c599b-vbpsl_c27d2e72-75e7-4a45-9da6-90e551098894/manager/0.log" Jul 23 05:07:17.746142 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:17.746063 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7b978c5b45-76rh9_50d4a629-3155-4fd7-9cf9-3c8b7250a1ab/maas-api/0.log" Jul 23 05:07:17.973675 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:17.973648 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2n995_75e09282-a4c3-4a46-8f0c-ebf4d0fb0cfd/postgres/0.log" Jul 23 05:07:18.755922 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.755884 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/util/0.log" Jul 23 05:07:18.763466 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.763442 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/pull/0.log" Jul 23 05:07:18.770683 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.770659 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/extract/0.log" Jul 23 05:07:18.881995 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.881972 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/util/0.log" Jul 23 05:07:18.889529 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.889497 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/pull/0.log" Jul 23 05:07:18.896805 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:18.896790 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/extract/0.log" Jul 23 05:07:19.012549 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.012471 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/util/0.log" Jul 23 05:07:19.024119 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.024097 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/pull/0.log" Jul 23 05:07:19.035875 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.035847 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/extract/0.log" Jul 23 05:07:19.152241 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.152210 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/util/0.log" Jul 23 05:07:19.159779 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.159754 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/pull/0.log" Jul 23 05:07:19.167146 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.167122 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/extract/0.log" Jul 23 05:07:19.405853 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.405825 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvrkw_259d6262-877d-42a2-9aa8-c884c2a0dd97/manager/0.log" Jul 23 05:07:19.519217 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.519191 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8qt2r_ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08/manager/0.log" Jul 23 05:07:19.747541 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:19.747451 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t94k5_17c0098a-d795-4dd8-b7ec-27a1b68e3264/registry-server/0.log" Jul 23 05:07:20.468830 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:20.468798 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bb6jn_324e757d-b7aa-496c-aea7-8ac3511db89b/istio-proxy/0.log" Jul 23 05:07:20.941178 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:20.941148 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/1.log" Jul 23 05:07:21.179656 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:21.179604 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkzll_df5d121b-d1f3-4fd5-9166-74ac5755c592/payload-processing/0.log" Jul 23 05:07:21.627538 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:21.627504 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mjt48_c1d070e3-dd6b-431c-8110-e1b3c303a204/main/0.log" Jul 23 05:07:21.856214 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:21.856182 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vkvt2_8526330d-1f19-4019-9d3f-4f9117d541bb/main/0.log" Jul 23 05:07:27.538297 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.538243 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gks9x/must-gather-crvcl"] Jul 23 05:07:27.542396 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.542370 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.545164 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.545143 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gks9x\"/\"default-dockercfg-2lcg7\"" Jul 23 05:07:27.545298 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.545146 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gks9x\"/\"openshift-service-ca.crt\"" Jul 23 05:07:27.545729 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.545713 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gks9x\"/\"kube-root-ca.crt\"" Jul 23 05:07:27.554441 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.554409 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:07:27.560678 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.560651 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gks9x/must-gather-crvcl"] Jul 23 05:07:27.611903 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.611867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775eb653-4afc-4450-8e13-2cb218edca17-must-gather-output\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.612095 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.612008 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4g2\" (UniqueName: \"kubernetes.io/projected/775eb653-4afc-4450-8e13-2cb218edca17-kube-api-access-dh4g2\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.712544 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.712461 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775eb653-4afc-4450-8e13-2cb218edca17-must-gather-output\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.712740 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.712543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4g2\" (UniqueName: \"kubernetes.io/projected/775eb653-4afc-4450-8e13-2cb218edca17-kube-api-access-dh4g2\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.712869 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.712849 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/775eb653-4afc-4450-8e13-2cb218edca17-must-gather-output\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.723981 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.723955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4g2\" (UniqueName: \"kubernetes.io/projected/775eb653-4afc-4450-8e13-2cb218edca17-kube-api-access-dh4g2\") pod \"must-gather-crvcl\" (UID: \"775eb653-4afc-4450-8e13-2cb218edca17\") " pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.852988 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.852894 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gks9x/must-gather-crvcl" Jul 23 05:07:27.996968 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:27.996935 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gks9x/must-gather-crvcl"] Jul 23 05:07:27.998441 ip-10-0-139-3 kubenswrapper[2570]: W0723 05:07:27.998409 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775eb653_4afc_4450_8e13_2cb218edca17.slice/crio-1c2c7915b5405f4f148f6fe74e33fd018deaaae360a7c725e1f2e2295731963d WatchSource:0}: Error finding container 1c2c7915b5405f4f148f6fe74e33fd018deaaae360a7c725e1f2e2295731963d: Status 404 returned error can't find the container with id 1c2c7915b5405f4f148f6fe74e33fd018deaaae360a7c725e1f2e2295731963d Jul 23 05:07:28.000459 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:28.000442 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 05:07:28.130214 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:28.130179 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gks9x/must-gather-crvcl" event={"ID":"775eb653-4afc-4450-8e13-2cb218edca17","Type":"ContainerStarted","Data":"1c2c7915b5405f4f148f6fe74e33fd018deaaae360a7c725e1f2e2295731963d"} Jul 23 05:07:28.646004 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:28.645973 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" limit=1024 Jul 23 05:07:29.137599 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:29.137560 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gks9x/must-gather-crvcl" event={"ID":"775eb653-4afc-4450-8e13-2cb218edca17","Type":"ContainerStarted","Data":"9365a6719baa636e204a24d4325ac14c79c1ac63ccc5fa7fac2a5934ad8005ca"} Jul 23 05:07:29.137829 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:29.137613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gks9x/must-gather-crvcl" event={"ID":"775eb653-4afc-4450-8e13-2cb218edca17","Type":"ContainerStarted","Data":"198236cfc077198186adc024105d67d5ac93e9cc37930de427952659f7fdfb61"} Jul 23 05:07:29.156179 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:29.156123 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gks9x/must-gather-crvcl" podStartSLOduration=1.473399909 podStartE2EDuration="2.156106397s" totalImagesPullingTime="682.706488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 05:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 05:07:29.1532379 +0000 UTC m=+1702.389279159" watchObservedRunningTime="2026-07-23 05:07:29.156106397 +0000 UTC m=+1702.392147654" Jul 23 05:07:30.375780 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:30.375744 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wllts_4cb7174a-e1f8-4b2b-8c2e-70a38284943c/global-pull-secret-syncer/0.log" Jul 23 05:07:30.437931 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:30.437880 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mrb8_6b636121-f124-4497-879f-5d1e7f68fecf/konnectivity-agent/0.log" Jul 23 05:07:30.575776 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:30.575739 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-3.ec2.internal_96fd72404baf0a9d1f61b80c08212cf9/haproxy/0.log" Jul 23 05:07:34.933748 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:34.933699 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/extract/0.log" Jul 23 05:07:34.956836 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:34.956809 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/util/0.log" Jul 23 05:07:34.982268 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:34.982228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599xdbx_71fa78a2-2499-44f9-8521-b16f326137f9/pull/0.log" Jul 23 05:07:35.011416 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.011374 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/extract/0.log" Jul 23 05:07:35.035210 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.035184 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/util/0.log" Jul 23 05:07:35.057750 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.057724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v4d4r_681f9037-d4a4-42b2-b537-c27a02d51393/pull/0.log" Jul 23 05:07:35.111707 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.111680 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/extract/0.log" Jul 23 05:07:35.136236 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.136205 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/util/0.log" Jul 23 05:07:35.159782 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.159750 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8sg4_878cfae5-330d-455a-8a89-186db0a65749/pull/0.log" Jul 23 05:07:35.194401 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.194305 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/extract/0.log" Jul 23 05:07:35.217144 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.217108 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/util/0.log" Jul 23 05:07:35.239988 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.239952 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c5dwt_87cf5587-adb2-47b4-b356-4e6591f226b0/pull/0.log" Jul 23 05:07:35.706470 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.706436 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nvrkw_259d6262-877d-42a2-9aa8-c884c2a0dd97/manager/0.log" Jul 23 05:07:35.735552 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.735512 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8qt2r_ec0cb64f-e1b6-4ad5-a2e7-d4f795f21c08/manager/0.log" Jul 23 05:07:35.815828 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:35.815793 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t94k5_17c0098a-d795-4dd8-b7ec-27a1b68e3264/registry-server/0.log" Jul 23 05:07:37.503809 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.503775 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/alertmanager/0.log" Jul 23 05:07:37.533409 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.533376 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/config-reloader/0.log" Jul 23 05:07:37.558834 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.558801 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/kube-rbac-proxy-web/0.log" Jul 23 05:07:37.594959 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.594923 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/kube-rbac-proxy/0.log" Jul 23 05:07:37.627331 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.627220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/kube-rbac-proxy-metric/0.log" Jul 23 05:07:37.653827 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.653803 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/prom-label-proxy/0.log" Jul 23 05:07:37.680594 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.680050 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31c547fc-05ae-44eb-9b47-2e2670f2c13a/init-config-reloader/0.log" Jul 23 05:07:37.886946 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:37.886922 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-dv4jx_f18e5fe2-0f33-476a-90fa-89feea060e14/monitoring-plugin/0.log" Jul 23 05:07:38.003390 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.003359 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqpvq_bcd26da0-2d55-453c-b804-a9d0980080b4/node-exporter/0.log" Jul 23 05:07:38.027561 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.027469 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqpvq_bcd26da0-2d55-453c-b804-a9d0980080b4/kube-rbac-proxy/0.log" Jul 23 05:07:38.051868 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.051843 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqpvq_bcd26da0-2d55-453c-b804-a9d0980080b4/init-textfile/0.log" Jul 23 05:07:38.484828 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.484790 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-xj7vl_7d30f72b-0b36-4d5d-9b9c-ac844761f8d7/prometheus-operator-admission-webhook/0.log" Jul 23 05:07:38.516113 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.516084 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7878b5dd97-zwpzc_188b32c7-9511-458d-960c-ae4629042a99/telemeter-client/0.log" Jul 23 05:07:38.544080 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.544052 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7878b5dd97-zwpzc_188b32c7-9511-458d-960c-ae4629042a99/reload/0.log" Jul 23 05:07:38.573289 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:38.573224 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7878b5dd97-zwpzc_188b32c7-9511-458d-960c-ae4629042a99/kube-rbac-proxy/0.log" Jul 23 05:07:40.519226 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.519181 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/1.log" Jul 23 05:07:40.528357 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.528314 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tdnmm_4eab6cd5-9527-48f1-8c43-fb823a201a06/console-operator/2.log" Jul 23 05:07:40.580217 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.580177 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f"] Jul 23 05:07:40.588476 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.588441 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.593364 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.593333 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f"] Jul 23 05:07:40.665136 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.665095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-lib-modules\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.665420 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.665395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pbfw\" (UniqueName: \"kubernetes.io/projected/515708a7-c035-4f4c-872a-1805191e50d0-kube-api-access-6pbfw\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.665636 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.665598 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-sys\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.665841 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.665822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-proc\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.665999 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.665983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-podres\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767422 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-sys\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-proc\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-podres\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767522 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-sys\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-lib-modules\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767607 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767579 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pbfw\" (UniqueName: \"kubernetes.io/projected/515708a7-c035-4f4c-872a-1805191e50d0-kube-api-access-6pbfw\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767888 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767640 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-proc\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767888 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767670 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-podres\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.767888 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.767707 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515708a7-c035-4f4c-872a-1805191e50d0-lib-modules\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.776437 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.776361 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pbfw\" (UniqueName: \"kubernetes.io/projected/515708a7-c035-4f4c-872a-1805191e50d0-kube-api-access-6pbfw\") pod \"perf-node-gather-daemonset-x4t6f\" (UID: \"515708a7-c035-4f4c-872a-1805191e50d0\") " pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:40.907113 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:40.907071 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:41.123100 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.123058 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f"] Jul 23 05:07:41.126039 ip-10-0-139-3 kubenswrapper[2570]: W0723 05:07:41.125999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod515708a7_c035_4f4c_872a_1805191e50d0.slice/crio-f0db0e89682173617f8dbb3b4518abb933be84eed039a576bb55690bdd7037ff WatchSource:0}: Error finding container f0db0e89682173617f8dbb3b4518abb933be84eed039a576bb55690bdd7037ff: Status 404 returned error can't find the container with id f0db0e89682173617f8dbb3b4518abb933be84eed039a576bb55690bdd7037ff Jul 23 05:07:41.183743 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.183717 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c9b785b84-k99tk_50176397-4f3a-4eec-9211-b47fdc356510/console/0.log" Jul 23 05:07:41.239283 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.239243 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" event={"ID":"515708a7-c035-4f4c-872a-1805191e50d0","Type":"ContainerStarted","Data":"a88ebf1e05c7c63d9a50d7af80ae489a805a18a59012c27007b947102633d541"} Jul 23 05:07:41.239461 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.239299 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" event={"ID":"515708a7-c035-4f4c-872a-1805191e50d0","Type":"ContainerStarted","Data":"f0db0e89682173617f8dbb3b4518abb933be84eed039a576bb55690bdd7037ff"} Jul 23 05:07:41.239461 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.239384 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:41.254271 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:41.254216 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" podStartSLOduration=1.254198436 podStartE2EDuration="1.254198436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 05:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 05:07:41.253569636 +0000 UTC m=+1714.489610895" watchObservedRunningTime="2026-07-23 05:07:41.254198436 +0000 UTC m=+1714.490239693" Jul 23 05:07:42.951886 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:42.951824 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tzm7s_0e0a230a-ea11-4882-b2bf-80d81758f55b/dns/0.log" Jul 23 05:07:42.974229 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:42.974166 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tzm7s_0e0a230a-ea11-4882-b2bf-80d81758f55b/kube-rbac-proxy/0.log" Jul 23 05:07:43.051112 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:43.051077 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9lfrx_054885b4-fca9-4be3-911e-ac40fe21741c/dns-node-resolver/0.log" Jul 23 05:07:43.663139 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:43.663097 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xbft6_db588ac8-e5ff-4986-aa27-0649ffabbd0a/node-ca/0.log" Jul 23 05:07:44.619433 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:44.619402 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bb6jn_324e757d-b7aa-496c-aea7-8ac3511db89b/istio-proxy/0.log" Jul 23 05:07:44.750037 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:44.749999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/0.log" Jul 23 05:07:44.786050 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:44.786004 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/1.log" Jul 23 05:07:44.841000 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:44.840970 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkzll_df5d121b-d1f3-4fd5-9166-74ac5755c592/payload-processing/0.log" Jul 23 05:07:45.479479 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:45.479455 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-frvlm_8524fdca-ef3f-4916-b6ac-35196de3322d/serve-healthcheck-canary/0.log" Jul 23 05:07:46.174515 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:46.174484 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpc2j_4d317758-96e2-4668-991d-c1a1fff86550/kube-rbac-proxy/0.log" Jul 23 05:07:46.196143 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:46.196106 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpc2j_4d317758-96e2-4668-991d-c1a1fff86550/exporter/0.log" Jul 23 05:07:46.220107 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:46.220070 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpc2j_4d317758-96e2-4668-991d-c1a1fff86550/extractor/0.log" Jul 23 05:07:47.259677 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:47.259648 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gks9x/perf-node-gather-daemonset-x4t6f" Jul 23 05:07:48.489373 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:48.489344 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6585c6c66d-f92mk_0d6716a6-d124-4dac-bbf9-19dbe9446dab/manager/0.log" Jul 23 05:07:48.729253 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:48.729208 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6576c599b-vbpsl_c27d2e72-75e7-4a45-9da6-90e551098894/manager/0.log" Jul 23 05:07:48.750488 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:48.750417 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6576c599b-vbpsl_c27d2e72-75e7-4a45-9da6-90e551098894/copy-manifests/0.log" Jul 23 05:07:50.188478 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:50.188442 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56ccd69865-brjnm_c3802b4c-a474-4019-9bfc-05887c9b9768/manager/0.log" Jul 23 05:07:51.390236 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:51.390193 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bb6jn_324e757d-b7aa-496c-aea7-8ac3511db89b/istio-proxy/0.log" Jul 23 05:07:51.492439 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:51.492398 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/0.log" Jul 23 05:07:51.523439 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:51.523408 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/1.log" Jul 23 05:07:51.561329 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:51.561291 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkzll_df5d121b-d1f3-4fd5-9166-74ac5755c592/payload-processing/0.log" Jul 23 05:07:52.733919 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:52.733890 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4bb6jn_324e757d-b7aa-496c-aea7-8ac3511db89b/istio-proxy/0.log" Jul 23 05:07:52.854224 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:52.854190 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/0.log" Jul 23 05:07:52.885779 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:52.885745 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x2kg6_6c011d78-23ef-42f4-9e0c-600e865e5b6b/istio-proxy/1.log" Jul 23 05:07:52.929180 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:52.929149 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkzll_df5d121b-d1f3-4fd5-9166-74ac5755c592/payload-processing/0.log" Jul 23 05:07:56.951177 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:56.951137 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8trqw_03d0e1b3-9879-44fa-b159-20f5aa944865/kube-multus/0.log" Jul 23 05:07:56.975033 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:56.975007 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/kube-multus-additional-cni-plugins/0.log" Jul 23 05:07:56.996689 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:56.996666 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/egress-router-binary-copy/0.log" Jul 23 05:07:57.019162 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.019135 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/cni-plugins/0.log" Jul 23 05:07:57.040519 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.040491 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/bond-cni-plugin/0.log" Jul 23 05:07:57.061768 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.061743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/routeoverride-cni/0.log" Jul 23 05:07:57.082078 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.082039 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/whereabouts-cni-bincopy/0.log" Jul 23 05:07:57.104080 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.104048 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-25tw7_6b2a91b5-e4b9-4e0c-8852-c90bc98d4c77/whereabouts-cni/0.log" Jul 23 05:07:57.546721 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.546685 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pcswx_aacb3060-88cb-44f2-9e1d-5635b5ae4506/network-metrics-daemon/0.log" Jul 23 05:07:57.567791 ip-10-0-139-3 kubenswrapper[2570]: I0723 05:07:57.567764 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pcswx_aacb3060-88cb-44f2-9e1d-5635b5ae4506/kube-rbac-proxy/0.log"