Jul 18 02:50:41.347048 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 18 02:50:41.347058 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 18 02:50:41.347065 ip-10-0-130-116 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 18 02:50:41.347270 ip-10-0-130-116 systemd[1]: Failed to start Kubernetes Kubelet. Jul 18 02:50:51.385952 ip-10-0-130-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 18 02:50:51.385968 ip-10-0-130-116 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f6f391b9c5ad40bbb1ad6ae0374f3c1c -- Jul 18 02:52:40.310408 ip-10-0-130-116 systemd[1]: Starting Kubernetes Kubelet... Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.694855 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699334 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699345 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699349 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699352 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699355 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699357 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699360 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:40.973866 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699363 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:40.773713 ip-10-0-130-116 systemd[1]: Started Kubernetes Kubelet. Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699365 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699368 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699371 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699374 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699376 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699379 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699382 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699385 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699388 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699390 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699393 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699396 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699398 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699400 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699403 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699405 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699408 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699410 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699413 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:40.981962 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699415 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699418 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699420 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699423 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699425 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699428 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699430 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699432 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699435 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699437 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699440 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699442 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699444 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699447 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699449 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699452 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699454 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699456 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699460 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:40.982781 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699464 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699467 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699470 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699473 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699475 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699478 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699481 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699484 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699486 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699489 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699492 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699494 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699498 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699500 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699502 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699505 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699507 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699510 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699512 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699515 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:40.983695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699517 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699519 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699522 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699524 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699526 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699528 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699531 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699533 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699535 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699538 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699540 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699543 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699545 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699549 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699553 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699556 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699561 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699564 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699568 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:40.984339 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699571 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699573 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699576 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699579 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699581 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699584 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699587 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699589 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699592 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699594 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699598 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699601 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699604 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.699606 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700315 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700323 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700327 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700330 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700333 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700335 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:40.985013 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700338 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700343 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700347 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700350 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700352 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700355 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700357 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700361 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700365 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700368 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700371 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700373 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700376 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700378 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700381 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700383 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700386 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700388 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700391 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700394 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:40.985642 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700396 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700399 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700401 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700404 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700407 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700409 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700412 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700414 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700417 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700420 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700422 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700425 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700428 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700430 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700432 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700435 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700437 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700440 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700442 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:40.986350 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700445 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700447 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700450 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700453 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700455 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700458 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700460 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700463 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700465 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700468 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700470 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700473 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700475 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700478 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700480 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700483 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700485 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700488 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700492 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700494 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:40.987532 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700496 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700499 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700503 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700506 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700509 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700512 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700515 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700517 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700520 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700523 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700526 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700529 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700532 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700535 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700538 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700541 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700543 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700546 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700549 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:40.990219 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700551 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700554 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700557 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700559 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700562 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700565 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700567 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700570 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700573 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700575 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700579 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700582 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700585 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700588 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700590 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700927 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700931 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700934 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700937 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700939 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:40.990918 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700941 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700944 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700947 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700949 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700952 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700954 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700957 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700960 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700963 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700965 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700968 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700971 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700974 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700976 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700980 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700982 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700984 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700987 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700990 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:40.993504 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700992 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700995 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700997 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.700999 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701002 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701005 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701007 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701009 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701012 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701014 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701016 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701019 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701021 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701023 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701026 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701028 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701031 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701033 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701036 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701039 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:40.994825 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701041 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701044 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701049 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701051 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701054 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701056 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701060 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701064 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701067 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701070 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701073 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701076 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701079 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701082 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701084 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701087 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701089 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701092 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701095 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701097 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:40.995471 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701099 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701102 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701104 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701106 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701109 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701111 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701114 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701116 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701137 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701152 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701155 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701158 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701160 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701163 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701168 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701172 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701176 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701179 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701181 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701184 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:40.996153 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701186 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701189 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701192 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701194 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701196 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701199 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701201 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701204 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701207 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701210 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701212 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701214 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701217 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701221 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.701224 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701293 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701300 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701305 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701311 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701318 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701322 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 02:52:40.998413 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701328 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701333 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701337 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701340 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701343 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701348 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701351 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701354 2556 flags.go:64] FLAG: --cgroup-root="" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701357 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701360 2556 flags.go:64] FLAG: --client-ca-file="" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701363 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701366 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701371 2556 flags.go:64] FLAG: --cluster-domain="" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701374 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701377 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701380 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701383 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701387 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701390 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701393 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701396 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701399 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701401 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701404 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 02:52:40.999487 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701408 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701410 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701414 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701417 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701420 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701422 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701425 2556 flags.go:64] FLAG: --enable-server="true" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701428 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701432 2556 flags.go:64] FLAG: --event-burst="100" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701435 2556 flags.go:64] FLAG: --event-qps="50" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701438 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701441 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701444 2556 flags.go:64] FLAG: --eviction-hard="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701449 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701452 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701455 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701458 2556 flags.go:64] FLAG: --eviction-soft="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701461 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701464 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701467 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701470 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701473 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701476 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701478 2556 flags.go:64] FLAG: --feature-gates="" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701482 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 02:52:41.000600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701485 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701487 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701490 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701503 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701507 2556 flags.go:64] FLAG: --help="false" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701509 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701512 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701515 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701519 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701524 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701528 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701532 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701536 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701540 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701544 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701549 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701553 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701560 2556 flags.go:64] FLAG: --kube-reserved="" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701564 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701568 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701573 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701577 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701582 2556 flags.go:64] FLAG: --lock-file="" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701586 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 02:52:41.002597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701590 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701595 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701602 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701606 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701611 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701615 2556 flags.go:64] FLAG: --logging-format="text" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701619 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701624 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701628 2556 flags.go:64] FLAG: --manifest-url="" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701632 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701638 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701642 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701647 2556 flags.go:64] FLAG: --max-pods="110" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701652 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701656 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701660 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701664 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701668 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701672 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701676 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701686 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701690 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701694 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 02:52:41.003923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701699 2556 flags.go:64] FLAG: --pod-cidr="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701703 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701712 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701716 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701720 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701724 2556 flags.go:64] FLAG: --port="10250" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701729 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701734 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b306909c05ab13f" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701738 2556 flags.go:64] FLAG: --qos-reserved="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701743 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701747 2556 flags.go:64] FLAG: --register-node="true" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701751 2556 flags.go:64] FLAG: --register-with-taints="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701756 2556 flags.go:64] FLAG: --registry-burst="10" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701760 2556 flags.go:64] FLAG: --registry-qps="5" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701765 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701769 2556 flags.go:64] FLAG: --reserved-memory="" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701774 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701778 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701783 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701787 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701791 2556 flags.go:64] FLAG: --runonce="false" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701795 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701800 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701804 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701808 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 02:52:41.017529 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701812 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701815 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701820 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701824 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701828 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701832 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701836 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701840 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701844 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701850 2556 flags.go:64] FLAG: --system-cgroups="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701854 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701862 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701866 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701872 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701877 2556 flags.go:64] FLAG: --tls-min-version="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701881 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701885 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701890 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701894 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701898 2556 flags.go:64] FLAG: --v="2" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701903 2556 flags.go:64] FLAG: --version="false" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701908 2556 flags.go:64] FLAG: --vmodule="" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701914 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.701918 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702072 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:41.018472 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702077 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702082 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702086 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702090 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702095 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702099 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702103 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702107 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702111 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702115 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702134 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702138 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702142 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702146 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702150 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702153 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702159 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702164 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702169 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702174 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:41.026931 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702179 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702183 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702187 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702190 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702194 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702198 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702202 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702207 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702212 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702217 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702221 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702225 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702229 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702233 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702237 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702240 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702244 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702248 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702251 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702255 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:41.027564 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702259 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702263 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702266 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702270 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702274 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702278 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702282 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702285 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702291 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702294 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702298 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702301 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702307 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702311 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702314 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702318 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702322 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702325 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702330 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702334 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:41.028396 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702338 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702342 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702346 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702349 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702353 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702357 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702360 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702364 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702368 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702371 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702375 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702378 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702382 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702385 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702389 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702393 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702397 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702400 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702404 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:41.029038 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702407 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702414 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702419 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702422 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702426 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702431 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702435 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702438 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702442 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702445 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702449 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702452 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702457 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702461 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702464 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702468 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702472 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702475 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:41.029671 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.702479 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.702486 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.709554 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.709575 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.710328 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.710344 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710403 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710409 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710414 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710417 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710421 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710423 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710426 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710429 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:41.030303 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710432 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710434 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710439 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710442 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710445 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710449 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710451 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710454 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710457 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710459 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710462 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710464 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710467 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710469 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710472 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710474 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710477 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710479 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710482 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:41.030730 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710484 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710487 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710495 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710498 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710500 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710503 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710505 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710508 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710510 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710513 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710515 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710517 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710520 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710522 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710525 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710531 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710534 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710537 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710541 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710543 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:41.031260 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710546 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710549 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710552 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710555 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710558 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710560 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710563 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710566 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710569 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710571 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710575 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710578 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710580 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710583 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710586 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710594 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710597 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710599 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710602 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:41.031828 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710605 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710607 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710610 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710612 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710615 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710617 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710620 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710622 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710626 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710628 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710631 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710635 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710637 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710640 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710642 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710645 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710647 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710650 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710652 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710655 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:41.032383 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710657 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710660 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710663 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710665 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710667 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710670 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710672 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710675 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710677 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710685 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710688 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710690 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710692 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.710697 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710844 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 02:52:41.033070 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710848 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710851 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710854 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710857 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710859 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710863 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710866 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710868 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710870 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710875 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710878 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710880 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710883 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710885 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710888 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710890 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710893 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710895 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710897 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710900 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 02:52:41.033775 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710904 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710908 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710911 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710914 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710917 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710920 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710923 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710931 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710934 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710937 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710939 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710942 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710945 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710947 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710950 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710953 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710955 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710959 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710961 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710964 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 02:52:41.034644 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710966 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710970 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710973 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710975 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710978 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710981 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710983 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710985 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710988 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710991 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710993 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710996 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.710998 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711000 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711003 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711005 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711007 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711010 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711012 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711015 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 02:52:41.035282 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711022 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711025 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711028 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711030 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711033 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711035 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711037 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711040 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711042 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711046 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711050 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711052 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711055 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711058 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711061 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711063 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711066 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711068 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711071 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 02:52:41.035910 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711073 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711075 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711078 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711080 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711083 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711085 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711088 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711090 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711092 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711095 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711097 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711100 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711102 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711104 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711113 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711115 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711136 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711140 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 02:52:41.036527 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:40.711143 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.711148 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.711274 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.713376 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.714622 2556 server.go:1019] "Starting client certificate rotation" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.714756 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.715448 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.717067 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.721342 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.737989 2556 log.go:25] "Validated CRI v1 runtime API" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.740202 2556 log.go:25] "Validated CRI v1 image API" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.740962 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 02:52:41.114226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.744219 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8fa0259c-5034-4327-af4a-517ed3af4988:/dev/nvme0n1p3 ab276fd7-caad-4df2-a886-044cbd8aba34:/dev/nvme0n1p4] Jul 18 02:52:41.114813 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.744249 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.749216 2556 manager.go:216] Machine: {Timestamp:2026-07-18 02:52:40.748694461 +0000 UTC m=+0.316765965 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3240060 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1faccf5636754cde90a029339607 SystemUUID:ec2b1fac-cf56-3675-4cde-90a029339607 BootID:f6f391b9-c5ad-40bb-b1ad-6ae0374f3c1c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:e3:f3:ff:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:e3:f3:ff:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:82:fa:95:2c:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.749312 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.749389 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.751734 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.752272 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.752299 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 02:52:41.115022 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.752897 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.752912 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.752923 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.754052 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.755361 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.757984 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758163 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758196 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758210 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758229 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758241 2556 kubelet.go:398] "Adding apiserver pod source" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758253 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758668 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.758688 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.761958 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.763968 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.763995 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765062 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765076 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765090 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765095 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765107 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765112 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765136 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765163 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765170 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765176 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765198 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.765205 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.766514 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.766522 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.767087 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.767087 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.769691 2556 server.go:1268] "Started kubelet" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.769752 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.769834 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.769908 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.773535 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.774567 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.774993 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-75wr7" Jul 18 02:52:41.115445 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.776913 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.778987 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.781504 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-75wr7" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.780732 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-116.ec2.internal.18c342a69f102615 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-116.ec2.internal,UID:ip-10-0-130-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-116.ec2.internal,},FirstTimestamp:2026-07-18 02:52:40.769488405 +0000 UTC m=+0.337559909,LastTimestamp:2026-07-18 02:52:40.769488405 +0000 UTC m=+0.337559909,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-116.ec2.internal,}" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785097 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785106 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.785191 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785851 2556 factory.go:55] Registering systemd factory Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785866 2556 factory.go:223] Registration of the systemd container factory successfully Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785983 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.785992 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786000 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786084 2556 factory.go:153] Registering CRI-O factory Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786098 2556 factory.go:223] Registration of the crio container factory successfully Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786154 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786164 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786164 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786201 2556 factory.go:103] Registering Raw factory Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786216 2556 manager.go:1196] Started watching for new ooms in manager Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.786611 2556 manager.go:349] Starting recovery of all containers Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.787355 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.787464 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.794478 2556 manager.go:354] Recovery completed Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.798903 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.801912 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.801939 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.801949 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.802593 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.802601 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.802611 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.802615 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.803284 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.118792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.803305 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.803327 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.804013 2556 policy_none.go:49] "None policy: Start" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.804024 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.804035 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.805031 2556 policy_none.go:47] "Start" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.840777 2556 manager.go:337] "Starting Device Plugin manager" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.840808 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.840818 2556 server.go:87] "Starting device plugin registration server" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.841058 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.841070 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.841172 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.841252 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.841261 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.841731 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.841786 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.908449 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.909610 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.909648 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.909671 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.909707 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.911715 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.941473 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.942248 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.942274 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.942287 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.942317 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:40.947872 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.947888 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-116.ec2.internal\": node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:40.963812 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.031157 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal"] Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.031334 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.032698 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.032730 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.032746 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.034022 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.034113 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.034155 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.119816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042609 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042629 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042632 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042653 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042638 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.042662 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.043651 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.043671 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.044296 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientMemory" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.044318 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.044327 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeHasSufficientPID" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.064111 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.081590 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-116.ec2.internal\" not found" node="ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.086800 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-116.ec2.internal\" not found" node="ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.087840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.087859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.122298 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.087874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0058f1d7ca6e164db62bc07c21346302-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"0058f1d7ca6e164db62bc07c21346302\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.164687 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0058f1d7ca6e164db62bc07c21346302-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"0058f1d7ca6e164db62bc07c21346302\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35ff894d233e290b4f1f47efca59e724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal\" (UID: \"35ff894d233e290b4f1f47efca59e724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.215705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.188152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0058f1d7ca6e164db62bc07c21346302-config\") pod \"kube-apiserver-proxy-ip-10-0-130-116.ec2.internal\" (UID: \"0058f1d7ca6e164db62bc07c21346302\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.326972 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.265354 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.424668 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.365853 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:41.424668 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.385005 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:41.424668 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:41.389669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:43.105459 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:41.466285 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.196612 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.143974 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.277788 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.236363 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:43.277788 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.246914 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.292208 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.292324 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.292324 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.347741 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.363642 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 02:47:42 +0000 UTC" deadline="2028-05-03 02:39:51.60522063 +0000 UTC" Jul 18 02:52:43.386188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.363677 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15719h47m8.241547711s" Jul 18 02:52:43.475632 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.448791 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.601312 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.549735 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.667785 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.650206 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.750428 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:43.750399 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-116.ec2.internal\" not found" Jul 18 02:52:43.794155 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.794122 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:43.839283 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:43.839255 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0058f1d7ca6e164db62bc07c21346302.slice/crio-8bbf7dcb2558c9002fdb27a219acec01ff699f814a34833230895650f9f2cd26 WatchSource:0}: Error finding container 8bbf7dcb2558c9002fdb27a219acec01ff699f814a34833230895650f9f2cd26: Status 404 returned error can't find the container with id 8bbf7dcb2558c9002fdb27a219acec01ff699f814a34833230895650f9f2cd26 Jul 18 02:52:43.839676 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:43.839652 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ff894d233e290b4f1f47efca59e724.slice/crio-96f726a0c5650700d5df409d09078718b114481e8029d16e4a40fdcc413ebf7b WatchSource:0}: Error finding container 96f726a0c5650700d5df409d09078718b114481e8029d16e4a40fdcc413ebf7b: Status 404 returned error can't find the container with id 96f726a0c5650700d5df409d09078718b114481e8029d16e4a40fdcc413ebf7b Jul 18 02:52:43.845356 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.845341 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 02:52:43.862556 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.862530 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" Jul 18 02:52:43.873962 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.873939 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 02:52:43.874994 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.874978 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" Jul 18 02:52:43.881587 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.881571 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 02:52:43.936442 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:43.936420 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:44.310035 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.310002 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:44.335892 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.335870 2556 apiserver.go:52] "Watching apiserver" Jul 18 02:52:44.346284 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.346252 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 02:52:44.349617 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.349588 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4xlcq","openshift-multus/network-metrics-daemon-df4d4","openshift-network-diagnostics/network-check-target-crs2k","openshift-network-operator/iptables-alerter-d9cl2","openshift-ovn-kubernetes/ovnkube-node-j7qfv","kube-system/global-pull-secret-syncer-wmh8j","kube-system/konnectivity-agent-s2thn","kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb","openshift-cluster-node-tuning-operator/tuned-r5lgr","openshift-dns/node-resolver-26jvp","openshift-image-registry/node-ca-tcjbm","openshift-multus/multus-v9rvx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal"] Jul 18 02:52:44.352446 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.352368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.355814 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.355037 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 02:52:44.355814 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.355270 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 02:52:44.355814 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.355290 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.355814 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.355291 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rncr9\"" Jul 18 02:52:44.357825 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.357566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:44.357825 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.357628 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:44.358127 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.358109 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.358186 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.358170 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.358278 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.358261 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k5c8d\"" Jul 18 02:52:44.358460 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.358445 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 02:52:44.358514 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.358498 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 02:52:44.359963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.359943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.362402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.362383 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 02:52:44.362477 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.362403 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.362586 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.362569 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 02:52:44.362693 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.362678 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkqsf\"" Jul 18 02:52:44.364356 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.364338 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.364585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.364571 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.366579 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.366562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.366662 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.366626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:44.367012 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.366992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.367182 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367167 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 02:52:44.367587 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367568 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.367687 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367635 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2dnq\"" Jul 18 02:52:44.367687 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 02:52:44.367793 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367765 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 02:52:44.367850 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.367808 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 02:52:44.368880 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.368858 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.371351 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.371334 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.371510 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.371463 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.371606 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.371572 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 02:52:44.371867 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.371851 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q4vsf\"" Jul 18 02:52:44.372109 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.372006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.374285 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.373681 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.374285 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.373758 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:44.375439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.374675 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p4x8h\"" Jul 18 02:52:44.375439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.374889 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 02:52:44.375439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.375091 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 02:52:44.376828 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.376809 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.377545 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.377349 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 02:52:44.379664 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.378855 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.379664 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.379145 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.379664 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.379493 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rhn2r\"" Jul 18 02:52:44.379837 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.379671 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.381105 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.380891 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6wfv\"" Jul 18 02:52:44.381193 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.381139 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.381429 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.381411 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.381744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.381725 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.383728 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.383709 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 02:52:44.384105 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.383942 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 02:52:44.385251 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.385231 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmsgj\"" Jul 18 02:52:44.385490 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.385476 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8l9d\" (UniqueName: \"kubernetes.io/projected/03951d41-340c-4d69-9af4-259adaa04047-kube-api-access-v8l9d\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e819eb0a-9c00-4320-9e66-1166175fb227-agent-certs\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-os-release\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/32287581-4065-4365-8dfc-d7eae616f79b-kube-api-access-pw4q4\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-conf-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-etc-kubernetes\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398525 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32287581-4065-4365-8dfc-d7eae616f79b-iptables-alerter-script\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-node-log\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398594 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-kubelet\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-kubelet\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398639 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d78fc5d-c305-41e4-a68b-6dd18c318c54-kube-api-access-8g6cr\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.399894 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32287581-4065-4365-8dfc-d7eae616f79b-host-slash\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e819eb0a-9c00-4320-9e66-1166175fb227-konnectivity-ca\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cni-binary-copy\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-socket-dir-parent\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-multus\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-multus-certs\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-systemd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cnibin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-bin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-var-lib-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-etc-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-netd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.398986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03951d41-340c-4d69-9af4-259adaa04047-ovn-node-metrics-cert\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.400678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-daemon-config\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399033 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-slash\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-netns\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-log-socket\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-config\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-k8s-cni-cncf-io\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-hostroot\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-systemd-units\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-bin\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-system-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-netns\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-ovn\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-env-overrides\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401965 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-script-lib\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.401965 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.399869 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8cfj6" Jul 18 02:52:44.412428 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.412054 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8cfj6" Jul 18 02:52:44.464502 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.464478 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 02:52:44.500089 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-kubelet\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.500210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.500210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbh99\" (UniqueName: \"kubernetes.io/projected/307595ab-24b7-4800-a2cc-cc39c6b289fd-kube-api-access-xbh99\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.500210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2g6\" (UniqueName: \"kubernetes.io/projected/d8817ec4-e873-40a7-9125-a7b8b78e7198-kube-api-access-fm2g6\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32287581-4065-4365-8dfc-d7eae616f79b-host-slash\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e819eb0a-9c00-4320-9e66-1166175fb227-konnectivity-ca\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cni-binary-copy\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-multus\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-systemd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-etc-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-netd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2d8k\" (UniqueName: \"kubernetes.io/projected/8842137b-da6a-43e8-a6e1-102347f625e0-kube-api-access-s2d8k\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.500455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-daemon-config\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-slash\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-netns\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-log-socket\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-run\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-kubelet\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-systemd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-dbus\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500667 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32287581-4065-4365-8dfc-d7eae616f79b-host-slash\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-system-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-multus\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-ovn\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.500972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500710 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-etc-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-var-lib-kubelet\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-host\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500774 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-ovn\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500810 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-netd\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-os-release\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-cnibin\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-registration-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500881 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-log-socket\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500931 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-netns\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-slash\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500966 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.500990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-system-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.501585 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-conf-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-os-release\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-etc-kubernetes\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501049 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-conf-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501080 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-etc-kubernetes\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32287581-4065-4365-8dfc-d7eae616f79b-iptables-alerter-script\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-node-log\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-systemd\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-kubelet\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-conf\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501328 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cni-binary-copy\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501335 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-serviceca\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.502236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d78fc5d-c305-41e4-a68b-6dd18c318c54-kube-api-access-8g6cr\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501371 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e819eb0a-9c00-4320-9e66-1166175fb227-konnectivity-ca\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501415 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-kubelet\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-socket-dir-parent\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-daemon-config\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-multus-certs\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-var-lib-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-node-log\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501586 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-cni-dir\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cnibin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-multus-socket-dir-parent\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501619 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-var-lib-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501620 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32287581-4065-4365-8dfc-d7eae616f79b-iptables-alerter-script\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501620 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-multus-certs\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-cnibin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.502929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-bin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501792 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-var-lib-cni-bin\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03951d41-340c-4d69-9af4-259adaa04047-ovn-node-metrics-cert\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.501895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-kubelet-config\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4035f302-88b2-4527-9bcd-424b00cd5de2-hosts-file\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4035f302-88b2-4527-9bcd-424b00cd5de2-tmp-dir\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-config\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-os-release\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502243 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-sys\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.503613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4nrq\" (UniqueName: \"kubernetes.io/projected/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-kube-api-access-w4nrq\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-device-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502451 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-k8s-cni-cncf-io\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-hostroot\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-k8s-cni-cncf-io\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-systemd-units\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-bin\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-systemd-units\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99fjh\" (UniqueName: \"kubernetes.io/projected/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-kube-api-access-99fjh\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502645 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-run-openvswitch\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03951d41-340c-4d69-9af4-259adaa04047-host-cni-bin\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-hostroot\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-config\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-netns\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d78fc5d-c305-41e4-a68b-6dd18c318c54-host-run-netns\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-env-overrides\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-script-lib\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8l9d\" (UniqueName: \"kubernetes.io/projected/03951d41-340c-4d69-9af4-259adaa04047-kube-api-access-v8l9d\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.502978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-modprobe-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-kubernetes\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-tmp\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e819eb0a-9c00-4320-9e66-1166175fb227-agent-certs\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/32287581-4065-4365-8dfc-d7eae616f79b-kube-api-access-pw4q4\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-env-overrides\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503165 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-lib-modules\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-host\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.504912 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-socket-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.505603 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503268 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-sys-fs\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.505603 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503324 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/03951d41-340c-4d69-9af4-259adaa04047-ovnkube-script-lib\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.505603 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503354 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysconfig\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.505603 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-etc-tuned\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.505603 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.503424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwt2\" (UniqueName: \"kubernetes.io/projected/4035f302-88b2-4527-9bcd-424b00cd5de2-kube-api-access-9zwt2\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.507409 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.507359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/03951d41-340c-4d69-9af4-259adaa04047-ovn-node-metrics-cert\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.509439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.509197 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e819eb0a-9c00-4320-9e66-1166175fb227-agent-certs\") pod \"konnectivity-agent-s2thn\" (UID: \"e819eb0a-9c00-4320-9e66-1166175fb227\") " pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.510151 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.510102 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g6cr\" (UniqueName: \"kubernetes.io/projected/1d78fc5d-c305-41e4-a68b-6dd18c318c54-kube-api-access-8g6cr\") pod \"multus-v9rvx\" (UID: \"1d78fc5d-c305-41e4-a68b-6dd18c318c54\") " pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.512591 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.512381 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:52:44.512591 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.512405 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:52:44.512591 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.512418 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:44.512591 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.512478 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:45.012453451 +0000 UTC m=+3.003349006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:44.514581 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.514526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/32287581-4065-4365-8dfc-d7eae616f79b-kube-api-access-pw4q4\") pod \"iptables-alerter-d9cl2\" (UID: \"32287581-4065-4365-8dfc-d7eae616f79b\") " pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.515996 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.515957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8l9d\" (UniqueName: \"kubernetes.io/projected/03951d41-340c-4d69-9af4-259adaa04047-kube-api-access-v8l9d\") pod \"ovnkube-node-j7qfv\" (UID: \"03951d41-340c-4d69-9af4-259adaa04047\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-var-lib-kubelet\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604421 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-host\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-cnibin\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-registration-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-systemd\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604534 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-conf\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-serviceca\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-host\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-systemd\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.605853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-kubelet-config\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4035f302-88b2-4527-9bcd-424b00cd5de2-hosts-file\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4035f302-88b2-4527-9bcd-424b00cd5de2-tmp-dir\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-cnibin\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.604745 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-os-release\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-registration-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-sys\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.604818 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:45.104803851 +0000 UTC m=+3.095699402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4nrq\" (UniqueName: \"kubernetes.io/projected/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-kube-api-access-w4nrq\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-device-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-var-lib-kubelet\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.606924 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-device-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99fjh\" (UniqueName: \"kubernetes.io/projected/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-kube-api-access-99fjh\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-modprobe-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-kubernetes\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-tmp\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-lib-modules\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-host\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-socket-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-sys-fs\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605116 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4035f302-88b2-4527-9bcd-424b00cd5de2-tmp-dir\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysconfig\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-etc-tuned\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwt2\" (UniqueName: \"kubernetes.io/projected/4035f302-88b2-4527-9bcd-424b00cd5de2-kube-api-access-9zwt2\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-modprobe-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.607521 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605250 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-kubernetes\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605194 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-os-release\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605316 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-d\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605392 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-lib-modules\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-host\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.604839 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-sys\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605550 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-socket-dir\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbh99\" (UniqueName: \"kubernetes.io/projected/307595ab-24b7-4800-a2cc-cc39c6b289fd-kube-api-access-xbh99\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-sys-fs\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysctl-conf\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605616 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2g6\" (UniqueName: \"kubernetes.io/projected/d8817ec4-e873-40a7-9125-a7b8b78e7198-kube-api-access-fm2g6\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605653 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4035f302-88b2-4527-9bcd-424b00cd5de2-hosts-file\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2d8k\" (UniqueName: \"kubernetes.io/projected/8842137b-da6a-43e8-a6e1-102347f625e0-kube-api-access-s2d8k\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605693 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-run\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-dbus\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605846 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-kubelet-config\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/307595ab-24b7-4800-a2cc-cc39c6b289fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.605897 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f31202-f2d7-4c3c-8343-7a64a7d6899f-dbus\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.606257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-serviceca\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.606318 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/307595ab-24b7-4800-a2cc-cc39c6b289fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.606378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-etc-sysconfig\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.606461 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8817ec4-e873-40a7-9125-a7b8b78e7198-etc-selinux\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.608982 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.606488 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:44.609485 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.606506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8842137b-da6a-43e8-a6e1-102347f625e0-run\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.609485 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:44.606534 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:52:45.106519374 +0000 UTC m=+3.097414929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:44.609485 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.608917 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-etc-tuned\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.609485 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.608978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8842137b-da6a-43e8-a6e1-102347f625e0-tmp\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.614904 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.614881 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2g6\" (UniqueName: \"kubernetes.io/projected/d8817ec4-e873-40a7-9125-a7b8b78e7198-kube-api-access-fm2g6\") pod \"aws-ebs-csi-driver-node-5rnvb\" (UID: \"d8817ec4-e873-40a7-9125-a7b8b78e7198\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.614904 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.614903 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99fjh\" (UniqueName: \"kubernetes.io/projected/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-kube-api-access-99fjh\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:44.615550 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.615502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwt2\" (UniqueName: \"kubernetes.io/projected/4035f302-88b2-4527-9bcd-424b00cd5de2-kube-api-access-9zwt2\") pod \"node-resolver-26jvp\" (UID: \"4035f302-88b2-4527-9bcd-424b00cd5de2\") " pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.616139 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.616083 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbh99\" (UniqueName: \"kubernetes.io/projected/307595ab-24b7-4800-a2cc-cc39c6b289fd-kube-api-access-xbh99\") pod \"multus-additional-cni-plugins-4xlcq\" (UID: \"307595ab-24b7-4800-a2cc-cc39c6b289fd\") " pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.617131 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.617093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4nrq\" (UniqueName: \"kubernetes.io/projected/afbddab1-fbe8-4b76-b3ec-ba176e3223c2-kube-api-access-w4nrq\") pod \"node-ca-tcjbm\" (UID: \"afbddab1-fbe8-4b76-b3ec-ba176e3223c2\") " pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.617131 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.617097 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2d8k\" (UniqueName: \"kubernetes.io/projected/8842137b-da6a-43e8-a6e1-102347f625e0-kube-api-access-s2d8k\") pod \"tuned-r5lgr\" (UID: \"8842137b-da6a-43e8-a6e1-102347f625e0\") " pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.668917 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.668887 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:52:44.677722 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.677701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v9rvx" Jul 18 02:52:44.679808 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.679782 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode819eb0a_9c00_4320_9e66_1166175fb227.slice/crio-4c2295aec8b7d22e9ca444aae57ac90439a074ea5500282c1332a7f7141ad6af WatchSource:0}: Error finding container 4c2295aec8b7d22e9ca444aae57ac90439a074ea5500282c1332a7f7141ad6af: Status 404 returned error can't find the container with id 4c2295aec8b7d22e9ca444aae57ac90439a074ea5500282c1332a7f7141ad6af Jul 18 02:52:44.687559 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.687536 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d78fc5d_c305_41e4_a68b_6dd18c318c54.slice/crio-06118b77e1b023d496d356826fdf406bfe4bfdfc727d3b0439b2bc27f11c15c1 WatchSource:0}: Error finding container 06118b77e1b023d496d356826fdf406bfe4bfdfc727d3b0439b2bc27f11c15c1: Status 404 returned error can't find the container with id 06118b77e1b023d496d356826fdf406bfe4bfdfc727d3b0439b2bc27f11c15c1 Jul 18 02:52:44.688149 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.688130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9cl2" Jul 18 02:52:44.696580 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.696559 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:52:44.698041 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.698000 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32287581_4065_4365_8dfc_d7eae616f79b.slice/crio-da35cf1cffc9f9e3bc6d519729e3bf676f9c5e0762f9383598ac6db1fd65bc39 WatchSource:0}: Error finding container da35cf1cffc9f9e3bc6d519729e3bf676f9c5e0762f9383598ac6db1fd65bc39: Status 404 returned error can't find the container with id da35cf1cffc9f9e3bc6d519729e3bf676f9c5e0762f9383598ac6db1fd65bc39 Jul 18 02:52:44.704783 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.704763 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" Jul 18 02:52:44.705914 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.705892 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03951d41_340c_4d69_9af4_259adaa04047.slice/crio-d888f7d85f5a36d933ce4bd44cf98d37977b74a1e9999af8b17ad8b6cf6ae316 WatchSource:0}: Error finding container d888f7d85f5a36d933ce4bd44cf98d37977b74a1e9999af8b17ad8b6cf6ae316: Status 404 returned error can't find the container with id d888f7d85f5a36d933ce4bd44cf98d37977b74a1e9999af8b17ad8b6cf6ae316 Jul 18 02:52:44.713632 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.713612 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" Jul 18 02:52:44.714917 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.714895 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8817ec4_e873_40a7_9125_a7b8b78e7198.slice/crio-bd828c5cd63a06d21f840c539c13c9ac2f72830ba63cea90903201325aa6e24c WatchSource:0}: Error finding container bd828c5cd63a06d21f840c539c13c9ac2f72830ba63cea90903201325aa6e24c: Status 404 returned error can't find the container with id bd828c5cd63a06d21f840c539c13c9ac2f72830ba63cea90903201325aa6e24c Jul 18 02:52:44.720760 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.720742 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" Jul 18 02:52:44.723096 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.723073 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307595ab_24b7_4800_a2cc_cc39c6b289fd.slice/crio-7d48ecd1a0a91b3d04c0b2d084bf0fe623bca3dd101bb4a7671a91f8110c20be WatchSource:0}: Error finding container 7d48ecd1a0a91b3d04c0b2d084bf0fe623bca3dd101bb4a7671a91f8110c20be: Status 404 returned error can't find the container with id 7d48ecd1a0a91b3d04c0b2d084bf0fe623bca3dd101bb4a7671a91f8110c20be Jul 18 02:52:44.729344 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.729327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26jvp" Jul 18 02:52:44.729678 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.729648 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8842137b_da6a_43e8_a6e1_102347f625e0.slice/crio-a387bd364fd662c43a2d844140494aff64457e649b2022033ec25b59d9f8c310 WatchSource:0}: Error finding container a387bd364fd662c43a2d844140494aff64457e649b2022033ec25b59d9f8c310: Status 404 returned error can't find the container with id a387bd364fd662c43a2d844140494aff64457e649b2022033ec25b59d9f8c310 Jul 18 02:52:44.735228 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.735156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tcjbm" Jul 18 02:52:44.741196 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.741173 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4035f302_88b2_4527_9bcd_424b00cd5de2.slice/crio-049b23dde96b6f643ced44595d78f58317cb3e082a4ef84553465d26d98fd037 WatchSource:0}: Error finding container 049b23dde96b6f643ced44595d78f58317cb3e082a4ef84553465d26d98fd037: Status 404 returned error can't find the container with id 049b23dde96b6f643ced44595d78f58317cb3e082a4ef84553465d26d98fd037 Jul 18 02:52:44.747516 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:52:44.747492 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbddab1_fbe8_4b76_b3ec_ba176e3223c2.slice/crio-9990dcd88249c0a018a8568459705fdee3ae75ff3297ebed6acac80161eeb702 WatchSource:0}: Error finding container 9990dcd88249c0a018a8568459705fdee3ae75ff3297ebed6acac80161eeb702: Status 404 returned error can't find the container with id 9990dcd88249c0a018a8568459705fdee3ae75ff3297ebed6acac80161eeb702 Jul 18 02:52:44.765287 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.765236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9cl2" event={"ID":"32287581-4065-4365-8dfc-d7eae616f79b","Type":"ContainerStarted","Data":"da35cf1cffc9f9e3bc6d519729e3bf676f9c5e0762f9383598ac6db1fd65bc39"} Jul 18 02:52:44.766284 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.766258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v9rvx" event={"ID":"1d78fc5d-c305-41e4-a68b-6dd18c318c54","Type":"ContainerStarted","Data":"06118b77e1b023d496d356826fdf406bfe4bfdfc727d3b0439b2bc27f11c15c1"} Jul 18 02:52:44.767266 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.767248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"35ff894d233e290b4f1f47efca59e724","Type":"ContainerStarted","Data":"96f726a0c5650700d5df409d09078718b114481e8029d16e4a40fdcc413ebf7b"} Jul 18 02:52:44.768287 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.768258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tcjbm" event={"ID":"afbddab1-fbe8-4b76-b3ec-ba176e3223c2","Type":"ContainerStarted","Data":"9990dcd88249c0a018a8568459705fdee3ae75ff3297ebed6acac80161eeb702"} Jul 18 02:52:44.769203 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.769183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" event={"ID":"8842137b-da6a-43e8-a6e1-102347f625e0","Type":"ContainerStarted","Data":"a387bd364fd662c43a2d844140494aff64457e649b2022033ec25b59d9f8c310"} Jul 18 02:52:44.770186 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.770160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerStarted","Data":"7d48ecd1a0a91b3d04c0b2d084bf0fe623bca3dd101bb4a7671a91f8110c20be"} Jul 18 02:52:44.771049 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.771033 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" event={"ID":"d8817ec4-e873-40a7-9125-a7b8b78e7198","Type":"ContainerStarted","Data":"bd828c5cd63a06d21f840c539c13c9ac2f72830ba63cea90903201325aa6e24c"} Jul 18 02:52:44.772170 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.772151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"d888f7d85f5a36d933ce4bd44cf98d37977b74a1e9999af8b17ad8b6cf6ae316"} Jul 18 02:52:44.773060 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.773041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2thn" event={"ID":"e819eb0a-9c00-4320-9e66-1166175fb227","Type":"ContainerStarted","Data":"4c2295aec8b7d22e9ca444aae57ac90439a074ea5500282c1332a7f7141ad6af"} Jul 18 02:52:44.774223 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.774191 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" event={"ID":"0058f1d7ca6e164db62bc07c21346302","Type":"ContainerStarted","Data":"8bbf7dcb2558c9002fdb27a219acec01ff699f814a34833230895650f9f2cd26"} Jul 18 02:52:44.775357 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:44.775323 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26jvp" event={"ID":"4035f302-88b2-4527-9bcd-424b00cd5de2","Type":"ContainerStarted","Data":"049b23dde96b6f643ced44595d78f58317cb3e082a4ef84553465d26d98fd037"} Jul 18 02:52:45.108787 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.108760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:45.108940 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.108802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:45.108940 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.108853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:45.108940 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108925 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108961 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108975 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108984 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108988 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.108996 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:52:46.108977287 +0000 UTC m=+4.099872853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.109032 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:46.109021311 +0000 UTC m=+4.099916866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:45.109094 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:45.109043 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:46.109037872 +0000 UTC m=+4.099933423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:45.355370 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.355340 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 02:52:45.415624 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.415535 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 02:47:44 +0000 UTC" deadline="2028-05-01 11:53:40.060713456 +0000 UTC" Jul 18 02:52:45.415624 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:45.415577 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15681h0m54.645143514s" Jul 18 02:52:46.120663 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.120618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:46.121533 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.120693 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:46.121533 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.120739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:46.121533 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.121159 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:46.121533 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.121242 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:52:48.121211263 +0000 UTC m=+6.112106818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:46.122309 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122272 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:52:46.122414 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122321 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:52:46.122414 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122335 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:46.122414 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122393 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:48.122376895 +0000 UTC m=+6.113272459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:46.122556 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122479 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:46.122556 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.122522 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:48.122509753 +0000 UTC m=+6.113405308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:46.416225 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.415912 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 02:47:44 +0000 UTC" deadline="2027-12-15 17:42:23.015292459 +0000 UTC" Jul 18 02:52:46.416225 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.416158 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12374h49m36.599140418s" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.489984 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.490113 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.490509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.490593 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.490648 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:46.490765 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:46.490723 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:46.791318 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.791249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"35ff894d233e290b4f1f47efca59e724","Type":"ContainerStarted","Data":"fd43d0a2e9a231024afd82269037076000beddf6972f80c2895eb4c5b58ce83a"} Jul 18 02:52:46.796742 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:46.796714 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" event={"ID":"0058f1d7ca6e164db62bc07c21346302","Type":"ContainerStarted","Data":"599e50fb195f1b9f32de59b8c40e5535ee39bf0bcfcd8a8eed5056a68277c7f4"} Jul 18 02:52:48.139885 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.139845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:48.140347 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.139932 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:48.140347 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.139979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:48.140347 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140104 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:48.140347 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140169 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:52:52.140149092 +0000 UTC m=+10.131044672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140568 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140625 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:52.140608684 +0000 UTC m=+10.131504243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140710 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140726 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140738 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:48.140849 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.140773 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:52:52.14076164 +0000 UTC m=+10.131657193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.488092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.488213 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.488592 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.488682 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.488757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:48.488948 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:48.488852 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:48.811076 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.810992 2556 generic.go:356] "Generic (PLEG): container finished" podID="35ff894d233e290b4f1f47efca59e724" containerID="fd43d0a2e9a231024afd82269037076000beddf6972f80c2895eb4c5b58ce83a" exitCode=0 Jul 18 02:52:48.811076 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.811045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"35ff894d233e290b4f1f47efca59e724","Type":"ContainerDied","Data":"fd43d0a2e9a231024afd82269037076000beddf6972f80c2895eb4c5b58ce83a"} Jul 18 02:52:48.827119 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:48.826474 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-116.ec2.internal" podStartSLOduration=5.826454266 podStartE2EDuration="5.826454266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:52:46.821452809 +0000 UTC m=+4.812348380" watchObservedRunningTime="2026-07-18 02:52:48.826454266 +0000 UTC m=+6.817349840" Jul 18 02:52:50.488340 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:50.488091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:50.488764 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:50.488354 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:50.488764 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:50.488092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:50.488764 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:50.488472 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:50.488764 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:50.488091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:50.488764 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:50.488549 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:52.171613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.171568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.171633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.171682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171743 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171797 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171826 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:53:00.171803521 +0000 UTC m=+18.162699092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171856 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:00.171839139 +0000 UTC m=+18.162734698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171799 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171885 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171899 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:52.172063 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.171933 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:00.171922119 +0000 UTC m=+18.162817677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:52:52.488470 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.488335 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:52.488470 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.488451 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:52.488835 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.488763 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:52.488930 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:52.488856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:52.488985 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.488927 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:52.488985 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:52.488967 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:54.488210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:54.488125 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:54.488210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:54.488151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:54.488674 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:54.488139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:54.488674 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:54.488245 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:54.488674 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:54.488320 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:54.488674 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:54.488441 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:56.487608 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:56.487561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:56.487608 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:56.487593 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:56.488124 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:56.487561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:56.488124 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:56.487688 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:56.488124 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:56.487743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:56.488124 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:56.487810 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:52:58.488165 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:58.488128 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:52:58.488608 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:58.488250 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:52:58.488608 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:58.488127 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:52:58.488608 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:58.488399 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:52:58.488608 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:52:58.488133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:52:58.488608 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:52:58.488493 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:00.235744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.235709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.235766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.235796 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235912 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235948 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235967 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:16.235950643 +0000 UTC m=+34.226846195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235972 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235983 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.236045 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:53:16.236026153 +0000 UTC m=+34.226921708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.235986 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:53:00.236198 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.236100 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:16.236089614 +0000 UTC m=+34.226985167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:53:00.488065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.487984 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:00.488065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.487985 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:00.488349 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:00.488108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:00.488349 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.488122 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:00.488349 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.488189 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:00.488349 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:00.488255 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:02.488542 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:02.488465 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:02.489024 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:02.488581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:02.489024 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:02.488679 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:02.489024 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:02.488584 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:02.489024 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:02.488732 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:02.489024 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:02.488809 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:03.843261 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.842952 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s2thn" event={"ID":"e819eb0a-9c00-4320-9e66-1166175fb227","Type":"ContainerStarted","Data":"3d11d806e6673206f82e336841e43fdba802a38d5173f5dfdcd6e08c241f4c25"} Jul 18 02:53:03.844926 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.844901 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26jvp" event={"ID":"4035f302-88b2-4527-9bcd-424b00cd5de2","Type":"ContainerStarted","Data":"f879ca115c5d6b8f5dccc7d3fa8bc947f090f2f6a7c061fe5beaa7f436c844b0"} Jul 18 02:53:03.846334 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.846292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v9rvx" event={"ID":"1d78fc5d-c305-41e4-a68b-6dd18c318c54","Type":"ContainerStarted","Data":"909fcc4bc4dc784f58f9b454c51ca277ae476e79ec445d7d0d44dd544c5f0df4"} Jul 18 02:53:03.848616 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.848594 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" event={"ID":"35ff894d233e290b4f1f47efca59e724","Type":"ContainerStarted","Data":"3611adef27aec67013efe3b945b82efb376ebb95183077afd87f4ae262ef2928"} Jul 18 02:53:03.850167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.850122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tcjbm" event={"ID":"afbddab1-fbe8-4b76-b3ec-ba176e3223c2","Type":"ContainerStarted","Data":"abfc513c1d0f989972c1c133199aea917fc948558827ec44dc2bc43964736720"} Jul 18 02:53:03.852189 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.851947 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" event={"ID":"8842137b-da6a-43e8-a6e1-102347f625e0","Type":"ContainerStarted","Data":"7b70c2b42f8de06b27de1500b84a4a2ff38fb7c1ece8941edfd0bf3efb1b295e"} Jul 18 02:53:03.853577 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.853492 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="7257c3b372c5f709ab021770a140fd2527e8c0ef4d6b67c2af3fad44c3c15eaa" exitCode=0 Jul 18 02:53:03.853666 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.853569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"7257c3b372c5f709ab021770a140fd2527e8c0ef4d6b67c2af3fad44c3c15eaa"} Jul 18 02:53:03.855588 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.855569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" event={"ID":"d8817ec4-e873-40a7-9125-a7b8b78e7198","Type":"ContainerStarted","Data":"3a98d9452a17f652322cf5fb0d84cf3c12d06d22c85139bda844513b578b0927"} Jul 18 02:53:03.886338 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.886277 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s2thn" podStartSLOduration=3.405105358 podStartE2EDuration="21.886264751s" totalImagesPullingTime="18.481159393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.859449793 +0000 UTC m=+21.850345362" watchObservedRunningTime="2026-07-18 02:53:03.886264751 +0000 UTC m=+21.877160323" Jul 18 02:53:03.900679 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.900634 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-26jvp" podStartSLOduration=3.484891316 podStartE2EDuration="21.900618296s" totalImagesPullingTime="18.41572698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.900459594 +0000 UTC m=+21.891355168" watchObservedRunningTime="2026-07-18 02:53:03.900618296 +0000 UTC m=+21.891513872" Jul 18 02:53:03.917160 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.917118 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-116.ec2.internal" podStartSLOduration=20.917103432 podStartE2EDuration="20.917103432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.916519901 +0000 UTC m=+21.907415532" watchObservedRunningTime="2026-07-18 02:53:03.917103432 +0000 UTC m=+21.907999006" Jul 18 02:53:03.933004 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.932949 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v9rvx" podStartSLOduration=3.441465654 podStartE2EDuration="21.932934719s" totalImagesPullingTime="18.491469065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.932452085 +0000 UTC m=+21.923347669" watchObservedRunningTime="2026-07-18 02:53:03.932934719 +0000 UTC m=+21.923830292" Jul 18 02:53:03.949081 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.949033 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r5lgr" podStartSLOduration=3.5211277880000003 podStartE2EDuration="21.949013078s" totalImagesPullingTime="18.42788529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.948447302 +0000 UTC m=+21.939342876" watchObservedRunningTime="2026-07-18 02:53:03.949013078 +0000 UTC m=+21.939908653" Jul 18 02:53:03.962824 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:03.962783 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tcjbm" podStartSLOduration=3.596372545 podStartE2EDuration="21.962771843s" totalImagesPullingTime="18.366399298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:03.962520343 +0000 UTC m=+21.953415916" watchObservedRunningTime="2026-07-18 02:53:03.962771843 +0000 UTC m=+21.953667416" Jul 18 02:53:04.487875 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.487842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:04.487875 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.487858 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:04.488070 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:04.487966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:04.488070 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:04.488007 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:04.488070 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.488062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:04.488176 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:04.488122 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:04.733132 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.733080 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 02:53:04.860026 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.859991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9cl2" event={"ID":"32287581-4065-4365-8dfc-d7eae616f79b","Type":"ContainerStarted","Data":"b8029c7e63f301d7430d534859fd85c19c1a8283cbae0ce56eaf6fcb31b2ea19"} Jul 18 02:53:04.861976 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.861949 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" event={"ID":"d8817ec4-e873-40a7-9125-a7b8b78e7198","Type":"ContainerStarted","Data":"1e0bdb6030cf0e43b93e2ddf6aa8545b04340dbfba99093349189392d5373b6e"} Jul 18 02:53:04.865804 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.865783 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:53:04.866240 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866212 2556 generic.go:356] "Generic (PLEG): container finished" podID="03951d41-340c-4d69-9af4-259adaa04047" containerID="fad8e1c0f5ebbb8accf14fade30968d6dc056794aee84bbcd7b7fb98e659c44f" exitCode=1 Jul 18 02:53:04.866391 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866374 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"3fd5adaccf5e6ed9896cf10cfe20f47bf93e77b0cc6c6103a480cd65113cc8d2"} Jul 18 02:53:04.866462 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"b822f47d4c5fea13f1fb1c2493010a6c32c2ed6475ce3822a33690b41197a3b6"} Jul 18 02:53:04.866524 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"bc51e92208588d0073be89cb2db5c5e421bf4b4a4af3f3b1ff30a8d1fe06c253"} Jul 18 02:53:04.866574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866552 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"d40d9d96104359d0954a9c818ca5fe06efc5674025e7ccd6e0ff7dbe0b5ba04e"} Jul 18 02:53:04.866623 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerDied","Data":"fad8e1c0f5ebbb8accf14fade30968d6dc056794aee84bbcd7b7fb98e659c44f"} Jul 18 02:53:04.866683 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.866645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"43f3c582562beef2d2e847bb6787ed5d059f87e2b1ee8a04c30209b32571599b"} Jul 18 02:53:04.875859 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:04.875809 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d9cl2" podStartSLOduration=4.446394695 podStartE2EDuration="22.87578952s" totalImagesPullingTime="18.429394825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:04.875396927 +0000 UTC m=+22.866292500" watchObservedRunningTime="2026-07-18 02:53:04.87578952 +0000 UTC m=+22.866685095" Jul 18 02:53:05.432255 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:05.432134 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T02:53:04.733098417Z","UUID":"c6497ed2-76e2-4175-bf50-ecb3cade53d6","Handler":null,"Name":"","Endpoint":""} Jul 18 02:53:05.433942 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:05.433913 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 02:53:05.434081 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:05.433959 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 02:53:06.389749 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.389703 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:53:06.390436 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.390419 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:53:06.487378 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.487193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:06.487540 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.487193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:06.487540 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:06.487453 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:06.487628 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:06.487572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:06.487628 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.487236 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:06.487732 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:06.487709 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:06.874121 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.874086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" event={"ID":"d8817ec4-e873-40a7-9125-a7b8b78e7198","Type":"ContainerStarted","Data":"35e99b99625be72ea19044a9244304e28ba542410e116d45f1fc3fc78cac72eb"} Jul 18 02:53:06.874377 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.874349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:53:06.874879 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.874859 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s2thn" Jul 18 02:53:06.892082 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:06.892039 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5rnvb" podStartSLOduration=4.093794877 podStartE2EDuration="24.892022008s" totalImagesPullingTime="20.798227131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:06.891548656 +0000 UTC m=+24.882444229" watchObservedRunningTime="2026-07-18 02:53:06.892022008 +0000 UTC m=+24.882917585" Jul 18 02:53:08.487713 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.487685 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:08.488365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.487684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:08.488365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.487684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:08.488365 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:08.487821 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:08.488365 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:08.487871 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:08.488365 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:08.487948 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:08.879875 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.879837 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="812fb4faf93093b7fd1833d1d8ad06d22bd462d45c79106b0d5aa1df7a6970dd" exitCode=0 Jul 18 02:53:08.880121 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.879911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"812fb4faf93093b7fd1833d1d8ad06d22bd462d45c79106b0d5aa1df7a6970dd"} Jul 18 02:53:08.882893 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.882869 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:53:08.883335 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:08.883270 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"a10ce98d9b503b8308f852144dbca73f86ac72de5435113280ab967e41eb6e2b"} Jul 18 02:53:09.290848 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:09.290774 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26jvp_4035f302-88b2-4527-9bcd-424b00cd5de2/dns-node-resolver/0.log" Jul 18 02:53:10.487480 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.487250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:10.487909 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.487250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:10.487909 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:10.487495 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:10.487909 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:10.487559 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:10.487909 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.487267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:10.487909 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:10.487650 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:10.653986 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.653960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tcjbm_afbddab1-fbe8-4b76-b3ec-ba176e3223c2/node-ca/0.log" Jul 18 02:53:10.888825 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.888795 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="c157a030577abe536ea2e983d32bf771ac7654526983a290e48416e40553d445" exitCode=0 Jul 18 02:53:10.888963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.888883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"c157a030577abe536ea2e983d32bf771ac7654526983a290e48416e40553d445"} Jul 18 02:53:10.892238 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.892222 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:53:10.892566 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.892549 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"d29554dc26297903b8638d5b55a66e94e02ffa8407413ac63ecb7bfef86bb56a"} Jul 18 02:53:10.892797 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.892782 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:10.892864 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.892837 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:10.892949 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.892934 2556 scope.go:117] "RemoveContainer" containerID="fad8e1c0f5ebbb8accf14fade30968d6dc056794aee84bbcd7b7fb98e659c44f" Jul 18 02:53:10.907940 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.907919 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:10.908167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:10.908151 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:11.898703 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.898681 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:53:11.899065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.899009 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" event={"ID":"03951d41-340c-4d69-9af4-259adaa04047","Type":"ContainerStarted","Data":"5d19e034b8bf33b315038dfc823e192bbb620f4e9262bac6b37e140e2f6431a1"} Jul 18 02:53:11.899065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.899051 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 18 02:53:11.901258 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.901234 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="225f9c9fb6adae3ff5c4cd4e33e430a570a148af1e13de7c05c3b1ec35f08ab4" exitCode=0 Jul 18 02:53:11.901374 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.901272 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"225f9c9fb6adae3ff5c4cd4e33e430a570a148af1e13de7c05c3b1ec35f08ab4"} Jul 18 02:53:11.944016 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:11.943977 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" podStartSLOduration=10.830416327 podStartE2EDuration="29.943964632s" totalImagesPullingTime="19.113548305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:11.943752108 +0000 UTC m=+29.934647693" watchObservedRunningTime="2026-07-18 02:53:11.943964632 +0000 UTC m=+29.934860250" Jul 18 02:53:12.251876 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.251700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wmh8j"] Jul 18 02:53:12.252012 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.251984 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:12.252106 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:12.252084 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:12.252550 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.252531 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-crs2k"] Jul 18 02:53:12.252648 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.252635 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:12.252741 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:12.252722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:12.253202 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.253178 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df4d4"] Jul 18 02:53:12.253351 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.253279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:12.253424 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:12.253382 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:12.903673 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:12.903647 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 18 02:53:13.487996 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:13.487965 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:13.488145 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:13.487965 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:13.488145 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:13.488068 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:13.488222 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:13.488169 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:14.487606 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:14.487575 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:14.488103 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:14.487699 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:14.524572 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:14.524542 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:15.487983 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:15.487950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:15.488513 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:15.488078 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:15.488513 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:15.488144 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:15.488513 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:15.488259 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:16.255368 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.255341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:16.255489 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.255383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:16.255489 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255481 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:53:16.255601 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.255486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:16.255601 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255529 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 02:53:16.255601 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255554 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 02:53:16.255601 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255553 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 02:53:16.255601 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255570 2556 projected.go:196] Error preparing data for projected volume kube-api-access-qdpzk for pod openshift-network-diagnostics/network-check-target-crs2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:53:16.255837 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255540 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs podName:16fbfead-eeb6-4383-b009-3ca4e8ce62d5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:48.255520661 +0000 UTC m=+66.246416212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs") pod "network-metrics-daemon-df4d4" (UID: "16fbfead-eeb6-4383-b009-3ca4e8ce62d5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 02:53:16.255837 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255630 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret podName:26f31202-f2d7-4c3c-8343-7a64a7d6899f nodeName:}" failed. No retries permitted until 2026-07-18 02:53:48.25561358 +0000 UTC m=+66.246509140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret") pod "global-pull-secret-syncer-wmh8j" (UID: "26f31202-f2d7-4c3c-8343-7a64a7d6899f") : object "kube-system"/"original-pull-secret" not registered Jul 18 02:53:16.255837 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.255662 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk podName:c619434f-02f1-4141-8c2b-f392aa0fe2f5 nodeName:}" failed. No retries permitted until 2026-07-18 02:53:48.255652618 +0000 UTC m=+66.246548183 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qdpzk" (UniqueName: "kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk") pod "network-check-target-crs2k" (UID: "c619434f-02f1-4141-8c2b-f392aa0fe2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 02:53:16.487752 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.487682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:16.487881 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:16.487774 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:16.916244 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.916212 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="f85306d481c4cc0c4dfce00ef7a9e85846e1b515b72f7132d355fd9dee4ba876" exitCode=0 Jul 18 02:53:16.916730 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:16.916268 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"f85306d481c4cc0c4dfce00ef7a9e85846e1b515b72f7132d355fd9dee4ba876"} Jul 18 02:53:17.487713 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:17.487683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:17.487863 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:17.487784 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:17.487863 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:17.487844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:17.487961 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:17.487943 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:17.920511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:17.920481 2556 generic.go:356] "Generic (PLEG): container finished" podID="307595ab-24b7-4800-a2cc-cc39c6b289fd" containerID="b261d3d1dbb0271ae8a4603282c9c17b95dede3da27a76b40fe4029719df61ff" exitCode=0 Jul 18 02:53:17.920831 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:17.920537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerDied","Data":"b261d3d1dbb0271ae8a4603282c9c17b95dede3da27a76b40fe4029719df61ff"} Jul 18 02:53:18.487082 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:18.487048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:18.487223 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:18.487170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:18.925691 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:18.925660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" event={"ID":"307595ab-24b7-4800-a2cc-cc39c6b289fd","Type":"ContainerStarted","Data":"a9be3661b1ac2ad9e1e3df6cdc48f2a24adfdd5883022b04b75142940d2f4b77"} Jul 18 02:53:18.954387 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:18.954332 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4xlcq" podStartSLOduration=8.096374793 podStartE2EDuration="36.954313663s" totalImagesPullingTime="28.85793887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:18.952896613 +0000 UTC m=+36.943792186" watchObservedRunningTime="2026-07-18 02:53:18.954313663 +0000 UTC m=+36.945209226" Jul 18 02:53:19.487113 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:19.487081 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:19.487321 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:19.487202 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:19.487321 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:19.487251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:19.487452 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:19.487345 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:20.487366 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:20.487335 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:20.487797 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:20.487424 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:21.488000 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:21.487968 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:21.488374 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:21.488064 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:21.488374 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:21.488123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:21.488374 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:21.488198 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:22.488206 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:22.488178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:22.488569 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:22.488252 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:23.487922 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:23.487893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:23.488080 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:23.487978 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:23.488080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:23.488034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:23.488146 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:23.488126 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:24.487269 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:24.487237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:24.487713 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:24.487341 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:25.487496 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:25.487472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:25.487836 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:25.487561 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:25.487836 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:25.487583 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:25.487836 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:25.487626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:26.487845 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:26.487815 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:26.488246 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:26.487924 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:27.487505 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:27.487474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:27.487668 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:27.487474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:27.487668 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:27.487570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:27.487668 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:27.487653 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:28.487378 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:28.487350 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:28.487728 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:28.487441 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:29.487783 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:29.487737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:29.488164 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:29.487740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:29.488164 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:29.487937 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:29.488164 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:29.487841 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:30.487095 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:30.487067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:30.487245 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:30.487157 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:31.487720 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:31.487689 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:31.488148 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:31.487778 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df4d4" podUID="16fbfead-eeb6-4383-b009-3ca4e8ce62d5" Jul 18 02:53:31.488148 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:31.487868 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:31.488148 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:31.487968 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-crs2k" podUID="c619434f-02f1-4141-8c2b-f392aa0fe2f5" Jul 18 02:53:32.490792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.488449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:32.490792 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:32.489169 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wmh8j" podUID="26f31202-f2d7-4c3c-8343-7a64a7d6899f" Jul 18 02:53:32.770770 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.770747 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-116.ec2.internal" event="NodeReady" Jul 18 02:53:32.770866 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.770857 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 02:53:32.819671 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.819646 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tkgld"] Jul 18 02:53:32.826952 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.826931 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cf7mj"] Jul 18 02:53:32.827066 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.827050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.830388 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.830373 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dvdjr\"" Jul 18 02:53:32.830832 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.830813 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 02:53:32.830962 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.830947 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 02:53:32.836240 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.836222 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkgld"] Jul 18 02:53:32.836330 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.836251 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cf7mj"] Jul 18 02:53:32.836374 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.836339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.838971 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.838950 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 02:53:32.839063 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.839001 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 02:53:32.839063 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.839015 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 02:53:32.839063 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.838950 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gxpkr\"" Jul 18 02:53:32.839650 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.838956 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 02:53:32.839965 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.839950 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ft88p"] Jul 18 02:53:32.849334 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.849317 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.851896 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.851867 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-57k4k\"" Jul 18 02:53:32.852073 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.852054 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 02:53:32.852175 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.852152 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 02:53:32.852477 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.852459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ft88p"] Jul 18 02:53:32.852559 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.852463 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 02:53:32.875867 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.875844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3669befa-3869-43cd-b14b-ed64b25154e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.875867 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.875868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010d94-80b4-4d8f-95f2-b7759976b6d7-tmp-dir\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.875964 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.875884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/651775d8-6881-4c80-8822-69e0f717189c-cert\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.876007 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.875983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3669befa-3869-43cd-b14b-ed64b25154e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.876040 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndkj\" (UniqueName: \"kubernetes.io/projected/98010d94-80b4-4d8f-95f2-b7759976b6d7-kube-api-access-wndkj\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.876068 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j725\" (UniqueName: \"kubernetes.io/projected/3669befa-3869-43cd-b14b-ed64b25154e8-kube-api-access-2j725\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.876098 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98010d94-80b4-4d8f-95f2-b7759976b6d7-metrics-tls\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.876129 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3669befa-3869-43cd-b14b-ed64b25154e8-crio-socket\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.876129 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876111 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3669befa-3869-43cd-b14b-ed64b25154e8-data-volume\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.876188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98010d94-80b4-4d8f-95f2-b7759976b6d7-config-volume\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.876188 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.876143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrs5\" (UniqueName: \"kubernetes.io/projected/651775d8-6881-4c80-8822-69e0f717189c-kube-api-access-zmrs5\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.977285 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j725\" (UniqueName: \"kubernetes.io/projected/3669befa-3869-43cd-b14b-ed64b25154e8-kube-api-access-2j725\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977310 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98010d94-80b4-4d8f-95f2-b7759976b6d7-metrics-tls\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.977439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3669befa-3869-43cd-b14b-ed64b25154e8-crio-socket\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3669befa-3869-43cd-b14b-ed64b25154e8-data-volume\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977439 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98010d94-80b4-4d8f-95f2-b7759976b6d7-config-volume\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.977638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrs5\" (UniqueName: \"kubernetes.io/projected/651775d8-6881-4c80-8822-69e0f717189c-kube-api-access-zmrs5\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.977638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3669befa-3869-43cd-b14b-ed64b25154e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3669befa-3869-43cd-b14b-ed64b25154e8-crio-socket\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010d94-80b4-4d8f-95f2-b7759976b6d7-tmp-dir\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.977638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/651775d8-6881-4c80-8822-69e0f717189c-cert\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.977871 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3669befa-3869-43cd-b14b-ed64b25154e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.977871 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndkj\" (UniqueName: \"kubernetes.io/projected/98010d94-80b4-4d8f-95f2-b7759976b6d7-kube-api-access-wndkj\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.977871 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.977811 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3669befa-3869-43cd-b14b-ed64b25154e8-data-volume\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.978030 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.978009 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98010d94-80b4-4d8f-95f2-b7759976b6d7-config-volume\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.978200 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.978178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3669befa-3869-43cd-b14b-ed64b25154e8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.981180 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.981153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3669befa-3869-43cd-b14b-ed64b25154e8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.981285 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.981223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98010d94-80b4-4d8f-95f2-b7759976b6d7-metrics-tls\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.981373 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.981359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/651775d8-6881-4c80-8822-69e0f717189c-cert\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.985346 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.985323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrs5\" (UniqueName: \"kubernetes.io/projected/651775d8-6881-4c80-8822-69e0f717189c-kube-api-access-zmrs5\") pod \"ingress-canary-ft88p\" (UID: \"651775d8-6881-4c80-8822-69e0f717189c\") " pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:32.986019 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.985997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j725\" (UniqueName: \"kubernetes.io/projected/3669befa-3869-43cd-b14b-ed64b25154e8-kube-api-access-2j725\") pod \"insights-runtime-extractor-cf7mj\" (UID: \"3669befa-3869-43cd-b14b-ed64b25154e8\") " pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:32.993074 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.993052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98010d94-80b4-4d8f-95f2-b7759976b6d7-tmp-dir\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:32.994678 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:32.994663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndkj\" (UniqueName: \"kubernetes.io/projected/98010d94-80b4-4d8f-95f2-b7759976b6d7-kube-api-access-wndkj\") pod \"dns-default-tkgld\" (UID: \"98010d94-80b4-4d8f-95f2-b7759976b6d7\") " pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:33.136880 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.136849 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:33.144994 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.144976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cf7mj" Jul 18 02:53:33.157255 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.157226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ft88p" Jul 18 02:53:33.310505 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.310480 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkgld"] Jul 18 02:53:33.316334 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.316308 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cf7mj"] Jul 18 02:53:33.323645 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:33.323612 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98010d94_80b4_4d8f_95f2_b7759976b6d7.slice/crio-11ef53766c1892bbdc4020802351f6b77da0f7a70f5476c59e4e85fbd9045545 WatchSource:0}: Error finding container 11ef53766c1892bbdc4020802351f6b77da0f7a70f5476c59e4e85fbd9045545: Status 404 returned error can't find the container with id 11ef53766c1892bbdc4020802351f6b77da0f7a70f5476c59e4e85fbd9045545 Jul 18 02:53:33.324430 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:33.324406 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3669befa_3869_43cd_b14b_ed64b25154e8.slice/crio-85ed49328d40eebd475b672fb30e7e0e9286ad37794db323b9aae3675a814d05 WatchSource:0}: Error finding container 85ed49328d40eebd475b672fb30e7e0e9286ad37794db323b9aae3675a814d05: Status 404 returned error can't find the container with id 85ed49328d40eebd475b672fb30e7e0e9286ad37794db323b9aae3675a814d05 Jul 18 02:53:33.328975 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.328942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ft88p"] Jul 18 02:53:33.332160 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:33.332143 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651775d8_6881_4c80_8822_69e0f717189c.slice/crio-2f4af585cfd284c65390ccede894fa84c7bc2649ea1c5794d2cb26d58fe1ce70 WatchSource:0}: Error finding container 2f4af585cfd284c65390ccede894fa84c7bc2649ea1c5794d2cb26d58fe1ce70: Status 404 returned error can't find the container with id 2f4af585cfd284c65390ccede894fa84c7bc2649ea1c5794d2cb26d58fe1ce70 Jul 18 02:53:33.487196 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.487126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:33.487196 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.487140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:33.489627 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.489602 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 02:53:33.489746 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.489625 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pzbm2\"" Jul 18 02:53:33.489746 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.489658 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 02:53:33.489746 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.489721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 02:53:33.489746 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.489723 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6tr6d\"" Jul 18 02:53:33.955359 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.955317 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cf7mj" event={"ID":"3669befa-3869-43cd-b14b-ed64b25154e8","Type":"ContainerStarted","Data":"85ed49328d40eebd475b672fb30e7e0e9286ad37794db323b9aae3675a814d05"} Jul 18 02:53:33.956731 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.956707 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ft88p" event={"ID":"651775d8-6881-4c80-8822-69e0f717189c","Type":"ContainerStarted","Data":"2f4af585cfd284c65390ccede894fa84c7bc2649ea1c5794d2cb26d58fe1ce70"} Jul 18 02:53:33.958065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:33.958041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgld" event={"ID":"98010d94-80b4-4d8f-95f2-b7759976b6d7","Type":"ContainerStarted","Data":"11ef53766c1892bbdc4020802351f6b77da0f7a70f5476c59e4e85fbd9045545"} Jul 18 02:53:34.488773 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:34.488126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:34.491396 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:34.491170 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 02:53:36.695957 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.695904 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:53:36.702792 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.702771 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.706242 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.706213 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 02:53:36.706367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.706260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 02:53:36.706367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.706263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fxq92\"" Jul 18 02:53:36.706473 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.706221 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 02:53:36.707729 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.707571 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 02:53:36.707729 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.707590 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 02:53:36.707729 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.707696 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 02:53:36.707729 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.707704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 02:53:36.709364 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.709003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:53:36.810522 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.810695 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.810695 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.810695 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.810831 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.810831 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.810737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c526q\" (UniqueName: \"kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911712 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911712 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911936 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911936 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911936 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.911936 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.911834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c526q\" (UniqueName: \"kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.912467 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.912445 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.912544 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.912445 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.912595 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.912543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.914247 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.914224 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.914420 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.914383 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:36.920342 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:36.920320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c526q\" (UniqueName: \"kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q\") pod \"console-549dcb6b76-5bf9n\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:37.013470 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:37.013387 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:39.025450 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.022899 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:53:39.977349 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.976637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ft88p" event={"ID":"651775d8-6881-4c80-8822-69e0f717189c","Type":"ContainerStarted","Data":"d92a8731e19f283f9e517792b23e4781cb3ec4ea63f46f878617bb5df61f45b1"} Jul 18 02:53:39.979190 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.979126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-549dcb6b76-5bf9n" event={"ID":"9cd10d74-b06c-4099-a3a8-c50a8444fd6b","Type":"ContainerStarted","Data":"b312533c0b2c2f55f7f97f3ebbdb0cf8e6691fa5f7be7156865129d657436743"} Jul 18 02:53:39.982213 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.982148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cf7mj" event={"ID":"3669befa-3869-43cd-b14b-ed64b25154e8","Type":"ContainerStarted","Data":"099ca592f8b5b16869923fb69867df37d4a919ccb10866b8a5b555de0d636f8b"} Jul 18 02:53:39.984916 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.984211 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgld" event={"ID":"98010d94-80b4-4d8f-95f2-b7759976b6d7","Type":"ContainerStarted","Data":"0449edab0398f7c3ab295216209fda97ca16df8b7cf4921f499677518bb18018"} Jul 18 02:53:39.984916 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.984251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgld" event={"ID":"98010d94-80b4-4d8f-95f2-b7759976b6d7","Type":"ContainerStarted","Data":"6823ede99fccd87537b8d6835124318a9aa964e746730807e9d87f5f8a6e3233"} Jul 18 02:53:39.984916 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.984815 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:39.994524 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:39.994413 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ft88p" podStartSLOduration=2.443032264 podStartE2EDuration="7.994382367s" totalImagesPullingTime="5.551350103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:39.992592684 +0000 UTC m=+57.983488252" watchObservedRunningTime="2026-07-18 02:53:39.994382367 +0000 UTC m=+57.985277945" Jul 18 02:53:40.011221 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:40.010899 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tkgld" podStartSLOduration=2.450289383 podStartE2EDuration="8.010886687s" totalImagesPullingTime="5.560597304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:40.010495423 +0000 UTC m=+58.001390997" watchObservedRunningTime="2026-07-18 02:53:40.010886687 +0000 UTC m=+58.001782260" Jul 18 02:53:40.899691 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:40.899663 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:53:40.901537 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:40.901519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:40.911729 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:40.911703 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 02:53:40.915437 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:40.915417 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:53:41.045579 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkjq\" (UniqueName: \"kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045744 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.045981 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.045872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.146833 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.146796 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.146833 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.146839 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147060 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.146866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147060 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.146984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147060 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147060 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147802 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkjq\" (UniqueName: \"kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147802 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.147968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.147832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.148216 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.148175 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.149764 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.149693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.149910 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.149889 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.157640 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.157619 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkjq\" (UniqueName: \"kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq\") pod \"console-6854f75857-qlpmc\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:41.213623 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:41.213589 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:44.231119 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:44.231090 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:53:44.233785 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:44.233763 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba8b396_54f9_4cfc_8ef8_22e2c0ef60a2.slice/crio-15be9ab8428a6095288cb5d28cacfb38e9058dc0e227674a01764650a81833f9 WatchSource:0}: Error finding container 15be9ab8428a6095288cb5d28cacfb38e9058dc0e227674a01764650a81833f9: Status 404 returned error can't find the container with id 15be9ab8428a6095288cb5d28cacfb38e9058dc0e227674a01764650a81833f9 Jul 18 02:53:44.534995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:44.534922 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7qfv" Jul 18 02:53:45.000338 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.000282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cf7mj" event={"ID":"3669befa-3869-43cd-b14b-ed64b25154e8","Type":"ContainerStarted","Data":"3c8583a1c28343245923a6b8d1103c8cfe2284fc1aabb189130356554f2f1ae4"} Jul 18 02:53:45.002072 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.002043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6854f75857-qlpmc" event={"ID":"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2","Type":"ContainerStarted","Data":"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610"} Jul 18 02:53:45.002186 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.002089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6854f75857-qlpmc" event={"ID":"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2","Type":"ContainerStarted","Data":"15be9ab8428a6095288cb5d28cacfb38e9058dc0e227674a01764650a81833f9"} Jul 18 02:53:45.003643 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.003623 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-549dcb6b76-5bf9n" event={"ID":"9cd10d74-b06c-4099-a3a8-c50a8444fd6b","Type":"ContainerStarted","Data":"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17"} Jul 18 02:53:45.023588 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.023531 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6854f75857-qlpmc" podStartSLOduration=5.023514522 podStartE2EDuration="5.023514522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:45.022920685 +0000 UTC m=+63.013816258" watchObservedRunningTime="2026-07-18 02:53:45.023514522 +0000 UTC m=+63.014410095" Jul 18 02:53:45.041841 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:45.041787 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-549dcb6b76-5bf9n" podStartSLOduration=3.94572256 podStartE2EDuration="9.041773161s" totalImagesPullingTime="5.096050601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:45.041469219 +0000 UTC m=+63.032364783" watchObservedRunningTime="2026-07-18 02:53:45.041773161 +0000 UTC m=+63.032668733" Jul 18 02:53:47.013668 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:47.013631 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:47.014131 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:47.013687 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:53:47.015245 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:47.015214 2556 patch_prober.go:28] interesting pod/console-549dcb6b76-5bf9n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 18 02:53:47.015401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:47.015288 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-549dcb6b76-5bf9n" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 18 02:53:48.016136 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.016102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cf7mj" event={"ID":"3669befa-3869-43cd-b14b-ed64b25154e8","Type":"ContainerStarted","Data":"66352360a78683595c5dfc3022f1603926c773354b9b52cf01678a1a99aee16a"} Jul 18 02:53:48.036815 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.036756 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cf7mj" podStartSLOduration=2.058085766 podStartE2EDuration="16.036737085s" totalImagesPullingTime="13.978651319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:53:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:48.035358466 +0000 UTC m=+66.026254034" watchObservedRunningTime="2026-07-18 02:53:48.036737085 +0000 UTC m=+66.027632659" Jul 18 02:53:48.306975 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.306947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:48.307116 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.306997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:48.307116 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.307023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:48.309634 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.309616 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 02:53:48.309685 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.309648 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 02:53:48.309733 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.309648 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 02:53:48.319618 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.319588 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16fbfead-eeb6-4383-b009-3ca4e8ce62d5-metrics-certs\") pod \"network-metrics-daemon-df4d4\" (UID: \"16fbfead-eeb6-4383-b009-3ca4e8ce62d5\") " pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:48.319618 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.319599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f31202-f2d7-4c3c-8343-7a64a7d6899f-original-pull-secret\") pod \"global-pull-secret-syncer-wmh8j\" (UID: \"26f31202-f2d7-4c3c-8343-7a64a7d6899f\") " pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:48.319618 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.319613 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 02:53:48.329545 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.329526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdpzk\" (UniqueName: \"kubernetes.io/projected/c619434f-02f1-4141-8c2b-f392aa0fe2f5-kube-api-access-qdpzk\") pod \"network-check-target-crs2k\" (UID: \"c619434f-02f1-4141-8c2b-f392aa0fe2f5\") " pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:48.498896 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.498865 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6tr6d\"" Jul 18 02:53:48.502843 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.502826 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pzbm2\"" Jul 18 02:53:48.506883 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.506871 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:48.511596 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.511580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df4d4" Jul 18 02:53:48.600698 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.600672 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wmh8j" Jul 18 02:53:48.632821 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.632792 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-crs2k"] Jul 18 02:53:48.635074 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:48.635046 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc619434f_02f1_4141_8c2b_f392aa0fe2f5.slice/crio-3476609e474aa8a03f3fb457cc9207d0724acc259e39ba13e9f18d8a7c1dc97a WatchSource:0}: Error finding container 3476609e474aa8a03f3fb457cc9207d0724acc259e39ba13e9f18d8a7c1dc97a: Status 404 returned error can't find the container with id 3476609e474aa8a03f3fb457cc9207d0724acc259e39ba13e9f18d8a7c1dc97a Jul 18 02:53:48.654374 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.654279 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df4d4"] Jul 18 02:53:48.725691 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:48.725660 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wmh8j"] Jul 18 02:53:48.728486 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:48.728463 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f31202_f2d7_4c3c_8343_7a64a7d6899f.slice/crio-5489e78cb8286f5b8aad82a53ede34d87ed33d1db41b063029297e1cd8ae33d1 WatchSource:0}: Error finding container 5489e78cb8286f5b8aad82a53ede34d87ed33d1db41b063029297e1cd8ae33d1: Status 404 returned error can't find the container with id 5489e78cb8286f5b8aad82a53ede34d87ed33d1db41b063029297e1cd8ae33d1 Jul 18 02:53:49.020425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:49.020341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wmh8j" event={"ID":"26f31202-f2d7-4c3c-8343-7a64a7d6899f","Type":"ContainerStarted","Data":"5489e78cb8286f5b8aad82a53ede34d87ed33d1db41b063029297e1cd8ae33d1"} Jul 18 02:53:49.021416 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:49.021388 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-crs2k" event={"ID":"c619434f-02f1-4141-8c2b-f392aa0fe2f5","Type":"ContainerStarted","Data":"3476609e474aa8a03f3fb457cc9207d0724acc259e39ba13e9f18d8a7c1dc97a"} Jul 18 02:53:49.022453 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:49.022431 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df4d4" event={"ID":"16fbfead-eeb6-4383-b009-3ca4e8ce62d5","Type":"ContainerStarted","Data":"3417643500f32cb22bd930d0c206ce94b52f7e9787db2cf8f6497f44c054a7d5"} Jul 18 02:53:50.992578 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:50.992543 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tkgld" Jul 18 02:53:51.034056 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.033992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df4d4" event={"ID":"16fbfead-eeb6-4383-b009-3ca4e8ce62d5","Type":"ContainerStarted","Data":"35d7198cc50f521b3b842c285a3ed0dff5181b17bca8b3c4d47ea508f15debf7"} Jul 18 02:53:51.034250 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.034064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df4d4" event={"ID":"16fbfead-eeb6-4383-b009-3ca4e8ce62d5","Type":"ContainerStarted","Data":"ae0a92e56f2ae1afca671ce23db0f14f438059231c4ae8c40095f33ac8def2f1"} Jul 18 02:53:51.050830 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.050762 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-df4d4" podStartSLOduration=67.355070121 podStartE2EDuration="1m9.05074256s" totalImagesPullingTime="1.695672439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:51.049889901 +0000 UTC m=+69.040785474" watchObservedRunningTime="2026-07-18 02:53:51.05074256 +0000 UTC m=+69.041638131" Jul 18 02:53:51.213980 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.213946 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:51.214157 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.214020 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:51.221536 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:51.221475 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:52.039901 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.039791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-crs2k" event={"ID":"c619434f-02f1-4141-8c2b-f392aa0fe2f5","Type":"ContainerStarted","Data":"08fbc7330c555c056e3f57f71f9b64172a2675bc93df61ad0f0fb30f49a8566f"} Jul 18 02:53:52.044647 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.044623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:53:52.056126 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.056076 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-crs2k" podStartSLOduration=67.02927116 podStartE2EDuration="1m10.05605846s" totalImagesPullingTime="3.0267873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:52.055614238 +0000 UTC m=+70.046509813" watchObservedRunningTime="2026-07-18 02:53:52.05605846 +0000 UTC m=+70.046954023" Jul 18 02:53:52.104123 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.104089 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:53:52.681289 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.681256 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2"] Jul 18 02:53:52.685472 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.685439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.689932 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.689757 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 02:53:52.689932 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.689787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 02:53:52.689932 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.689831 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 02:53:52.690899 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.690869 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 02:53:52.690899 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.690870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r9hxn\"" Jul 18 02:53:52.691071 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.690872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 02:53:52.698723 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.698555 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2"] Jul 18 02:53:52.699629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.699611 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5tlzb"] Jul 18 02:53:52.702864 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.702844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.705689 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.705666 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 02:53:52.705886 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.705870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 02:53:52.706333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.706061 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvzh8\"" Jul 18 02:53:52.706333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.706115 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 02:53:52.839450 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839416 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.839629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rqnk\" (UniqueName: \"kubernetes.io/projected/d2b75127-f076-493a-bca0-795effd4f258-kube-api-access-7rqnk\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.839629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-sys\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9x5m\" (UniqueName: \"kubernetes.io/projected/a41747ca-a9fc-4114-8948-6896c575a74a-kube-api-access-n9x5m\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839771 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.839771 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-textfile\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839771 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839705 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-wtmp\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839771 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-metrics-client-ca\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839922 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-root\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839922 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.839922 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b75127-f076-493a-bca0-795effd4f258-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.839922 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.839879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-tls\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940275 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-textfile\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940275 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-wtmp\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-metrics-client-ca\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-root\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b75127-f076-493a-bca0-795effd4f258-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-tls\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940467 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-wtmp\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940517 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rqnk\" (UniqueName: \"kubernetes.io/projected/d2b75127-f076-493a-bca0-795effd4f258-kube-api-access-7rqnk\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.940890 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-sys\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940890 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940572 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-textfile\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940890 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9x5m\" (UniqueName: \"kubernetes.io/projected/a41747ca-a9fc-4114-8948-6896c575a74a-kube-api-access-n9x5m\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940890 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.940890 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.941402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.940898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-root\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.941402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.941102 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41747ca-a9fc-4114-8948-6896c575a74a-sys\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.941402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.941219 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.941402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.941273 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a41747ca-a9fc-4114-8948-6896c575a74a-metrics-client-ca\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.941593 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.941535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2b75127-f076-493a-bca0-795effd4f258-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.943493 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.943398 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.943493 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.943450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.943641 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.943539 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a41747ca-a9fc-4114-8948-6896c575a74a-node-exporter-tls\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.943641 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.943617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2b75127-f076-493a-bca0-795effd4f258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.949224 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.949198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rqnk\" (UniqueName: \"kubernetes.io/projected/d2b75127-f076-493a-bca0-795effd4f258-kube-api-access-7rqnk\") pod \"openshift-state-metrics-79f6958cdf-g4pr2\" (UID: \"d2b75127-f076-493a-bca0-795effd4f258\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:52.949341 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.949315 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9x5m\" (UniqueName: \"kubernetes.io/projected/a41747ca-a9fc-4114-8948-6896c575a74a-kube-api-access-n9x5m\") pod \"node-exporter-5tlzb\" (UID: \"a41747ca-a9fc-4114-8948-6896c575a74a\") " pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:52.996441 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:52.996408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" Jul 18 02:53:53.013777 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.013744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5tlzb" Jul 18 02:53:53.044206 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.044173 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:53:53.561489 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:53.561453 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41747ca_a9fc_4114_8948_6896c575a74a.slice/crio-6f78ba408e774a9ddef37f6e46fa73b5a4e5f898cc24fdfa3abe54ee83d9a478 WatchSource:0}: Error finding container 6f78ba408e774a9ddef37f6e46fa73b5a4e5f898cc24fdfa3abe54ee83d9a478: Status 404 returned error can't find the container with id 6f78ba408e774a9ddef37f6e46fa73b5a4e5f898cc24fdfa3abe54ee83d9a478 Jul 18 02:53:53.689944 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.689889 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2"] Jul 18 02:53:53.692407 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:53.692380 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b75127_f076_493a_bca0_795effd4f258.slice/crio-eb83feb1e5a5ad71dfc2c9b8ea66aa50e241f343a4306e4e058ab3008d06ae8e WatchSource:0}: Error finding container eb83feb1e5a5ad71dfc2c9b8ea66aa50e241f343a4306e4e058ab3008d06ae8e: Status 404 returned error can't find the container with id eb83feb1e5a5ad71dfc2c9b8ea66aa50e241f343a4306e4e058ab3008d06ae8e Jul 18 02:53:53.755283 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.755246 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 02:53:53.758696 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.758660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.761490 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.761471 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 02:53:53.761588 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.761493 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 02:53:53.761588 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.761515 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 02:53:53.761695 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.761682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 02:53:53.762092 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762071 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 02:53:53.762191 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 02:53:53.762574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762558 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 02:53:53.762769 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762755 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 02:53:53.762852 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762824 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f97qw\"" Jul 18 02:53:53.762999 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.762732 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 02:53:53.775968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.775888 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 02:53:53.847995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.847966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848124 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848124 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848124 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848267 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848267 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5llb\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-kube-api-access-c5llb\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848267 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848267 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848267 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848236 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.848511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.848423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949282 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949282 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949710 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949710 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949710 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5llb\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-kube-api-access-c5llb\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949710 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:53:53.949626 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle podName:a48491e6-b231-49a5-98ba-7fef835a5e7b nodeName:}" failed. No retries permitted until 2026-07-18 02:53:54.449599537 +0000 UTC m=+72.440495096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a48491e6-b231-49a5-98ba-7fef835a5e7b") : configmap references non-existent config key: ca-bundle.crt Jul 18 02:53:53.949710 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.949963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.949848 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.950543 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.950518 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.952179 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.952075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-out\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.952495 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.952457 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.952560 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.952548 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-web-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.952911 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.952894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.953085 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.953064 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.953140 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.953071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.953140 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.953114 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.953753 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.953728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.954013 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.953995 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a48491e6-b231-49a5-98ba-7fef835a5e7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:53.959181 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:53.959165 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5llb\" (UniqueName: \"kubernetes.io/projected/a48491e6-b231-49a5-98ba-7fef835a5e7b-kube-api-access-c5llb\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:54.050027 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.049986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wmh8j" event={"ID":"26f31202-f2d7-4c3c-8343-7a64a7d6899f","Type":"ContainerStarted","Data":"9b8263fd84852abee4f301fbd6ff2d8f313349ea9803babbd49bf9d5b31343bb"} Jul 18 02:53:54.052107 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.052077 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" event={"ID":"d2b75127-f076-493a-bca0-795effd4f258","Type":"ContainerStarted","Data":"bde2739a9a664d595a2acdc6184f830769c9592df206b6838c5f452aae99b545"} Jul 18 02:53:54.052237 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.052130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" event={"ID":"d2b75127-f076-493a-bca0-795effd4f258","Type":"ContainerStarted","Data":"5387e29981cd3d63cb83f7a3a01b600e2cad31610fb02bb104a785cb05c27a6f"} Jul 18 02:53:54.052237 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.052156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" event={"ID":"d2b75127-f076-493a-bca0-795effd4f258","Type":"ContainerStarted","Data":"eb83feb1e5a5ad71dfc2c9b8ea66aa50e241f343a4306e4e058ab3008d06ae8e"} Jul 18 02:53:54.053355 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.053331 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tlzb" event={"ID":"a41747ca-a9fc-4114-8948-6896c575a74a","Type":"ContainerStarted","Data":"6f78ba408e774a9ddef37f6e46fa73b5a4e5f898cc24fdfa3abe54ee83d9a478"} Jul 18 02:53:54.069555 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.069463 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wmh8j" podStartSLOduration=67.189550211 podStartE2EDuration="1m12.069447872s" totalImagesPullingTime="4.879897661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:54.067552303 +0000 UTC m=+72.058447876" watchObservedRunningTime="2026-07-18 02:53:54.069447872 +0000 UTC m=+72.060343458" Jul 18 02:53:54.454097 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.454069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:54.454972 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.454945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a48491e6-b231-49a5-98ba-7fef835a5e7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a48491e6-b231-49a5-98ba-7fef835a5e7b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:54.669782 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.669751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 02:53:54.762215 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.762137 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5"] Jul 18 02:53:54.767161 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.767132 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.770284 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770256 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 18 02:53:54.770454 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770429 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 18 02:53:54.770702 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770685 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 18 02:53:54.770841 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770694 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 18 02:53:54.770841 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770751 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 18 02:53:54.770959 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770866 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bgtb92ou1qt4s\"" Jul 18 02:53:54.770959 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.770806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4q2jw\"" Jul 18 02:53:54.778736 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.778709 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5"] Jul 18 02:53:54.858908 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.858871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859054 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.858926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859054 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.858973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859054 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.859009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.859073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-grpc-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.859097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0889e23-25b9-47be-bcc1-a8c491f77f29-metrics-client-ca\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.859130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.859167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.859155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hft4c\" (UniqueName: \"kubernetes.io/projected/b0889e23-25b9-47be-bcc1-a8c491f77f29-kube-api-access-hft4c\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.957693 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.957663 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 02:53:54.960265 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-grpc-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960394 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0889e23-25b9-47be-bcc1-a8c491f77f29-metrics-client-ca\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960394 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960394 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hft4c\" (UniqueName: \"kubernetes.io/projected/b0889e23-25b9-47be-bcc1-a8c491f77f29-kube-api-access-hft4c\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960560 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960560 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960560 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.960560 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.960550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.961167 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.961131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0889e23-25b9-47be-bcc1-a8c491f77f29-metrics-client-ca\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.962050 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:54.962018 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48491e6_b231_49a5_98ba_7fef835a5e7b.slice/crio-848fd8a2c82a856fd0365bb57096803de57f3d0e521cf7fdc6f8aff0ae847df8 WatchSource:0}: Error finding container 848fd8a2c82a856fd0365bb57096803de57f3d0e521cf7fdc6f8aff0ae847df8: Status 404 returned error can't find the container with id 848fd8a2c82a856fd0365bb57096803de57f3d0e521cf7fdc6f8aff0ae847df8 Jul 18 02:53:54.963360 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.963291 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.963360 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.963343 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-grpc-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.963742 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.963724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.964161 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.964139 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-tls\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.964600 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.964558 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.964814 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.964793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0889e23-25b9-47be-bcc1-a8c491f77f29-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:54.970499 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:54.970480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hft4c\" (UniqueName: \"kubernetes.io/projected/b0889e23-25b9-47be-bcc1-a8c491f77f29-kube-api-access-hft4c\") pod \"thanos-querier-6bd9cb9c44-s48s5\" (UID: \"b0889e23-25b9-47be-bcc1-a8c491f77f29\") " pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:55.058999 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.058964 2556 generic.go:356] "Generic (PLEG): container finished" podID="a41747ca-a9fc-4114-8948-6896c575a74a" containerID="51cd3b8e67859ea2b106a58cfa99851ef5da105bce52e6bdeec3f41316bf3bd6" exitCode=0 Jul 18 02:53:55.059449 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.059055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tlzb" event={"ID":"a41747ca-a9fc-4114-8948-6896c575a74a","Type":"ContainerDied","Data":"51cd3b8e67859ea2b106a58cfa99851ef5da105bce52e6bdeec3f41316bf3bd6"} Jul 18 02:53:55.061339 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.061290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" event={"ID":"d2b75127-f076-493a-bca0-795effd4f258","Type":"ContainerStarted","Data":"d542a9dfdab03c29896d6bd0bfbbad3be43cd3bef6bac4fadf4551f99c2b5a72"} Jul 18 02:53:55.062597 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.062575 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"848fd8a2c82a856fd0365bb57096803de57f3d0e521cf7fdc6f8aff0ae847df8"} Jul 18 02:53:55.077959 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.077937 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:53:55.097926 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.097879 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-g4pr2" podStartSLOduration=2.045109088 podStartE2EDuration="3.097858847s" totalImagesPullingTime="1.052749759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:55.097277739 +0000 UTC m=+73.088173317" watchObservedRunningTime="2026-07-18 02:53:55.097858847 +0000 UTC m=+73.088754426" Jul 18 02:53:55.210855 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:55.210827 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5"] Jul 18 02:53:55.213032 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:55.213008 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0889e23_25b9_47be_bcc1_a8c491f77f29.slice/crio-a248351d320f512ec8ab73edd24a5b687c44c6207d9a43a4a064cd8bb749e4bf WatchSource:0}: Error finding container a248351d320f512ec8ab73edd24a5b687c44c6207d9a43a4a064cd8bb749e4bf: Status 404 returned error can't find the container with id a248351d320f512ec8ab73edd24a5b687c44c6207d9a43a4a064cd8bb749e4bf Jul 18 02:53:56.068212 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.068117 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"a248351d320f512ec8ab73edd24a5b687c44c6207d9a43a4a064cd8bb749e4bf"} Jul 18 02:53:56.071002 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.070971 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tlzb" event={"ID":"a41747ca-a9fc-4114-8948-6896c575a74a","Type":"ContainerStarted","Data":"64c4028cf24109f1e7af64e9f64174dae2660a3cf3d03e5f6e9d8939c707a3ca"} Jul 18 02:53:56.071130 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.071021 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tlzb" event={"ID":"a41747ca-a9fc-4114-8948-6896c575a74a","Type":"ContainerStarted","Data":"9cda1faf3f6d2449230fc8d5efd2dfecff63be204bf493bec54c8ae4a404eb72"} Jul 18 02:53:56.090511 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.090456 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5tlzb" podStartSLOduration=3.125910341 podStartE2EDuration="4.090435541s" totalImagesPullingTime="890.664539ms" totalInitContainerRuntime="73.860661ms" isStatefulPod=true podCreationTimestamp="2026-07-18 02:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:53:56.089545446 +0000 UTC m=+74.080441032" watchObservedRunningTime="2026-07-18 02:53:56.090435541 +0000 UTC m=+74.081331113" Jul 18 02:53:56.988712 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.988675 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7647fcb556-h6fwh"] Jul 18 02:53:56.992130 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.992109 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:56.994724 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.994703 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 18 02:53:56.995834 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.995803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 18 02:53:56.995834 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.995827 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 18 02:53:56.996002 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.995855 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 18 02:53:56.996534 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.996517 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h7dsn\"" Jul 18 02:53:56.996614 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:56.996522 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1b4f9fr9nq0hn\"" Jul 18 02:53:57.002637 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.002611 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7647fcb556-h6fwh"] Jul 18 02:53:57.076903 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.076860 2556 generic.go:356] "Generic (PLEG): container finished" podID="a48491e6-b231-49a5-98ba-7fef835a5e7b" containerID="cec145215eb7e114206ede32679d529ca96bb1f5331b1125c9e7e17e4d77599e" exitCode=0 Jul 18 02:53:57.077367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.076909 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerDied","Data":"cec145215eb7e114206ede32679d529ca96bb1f5331b1125c9e7e17e4d77599e"} Jul 18 02:53:57.077367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnr4c\" (UniqueName: \"kubernetes.io/projected/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-kube-api-access-jnr4c\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-metrics-server-audit-profiles\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077367 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-audit-log\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077570 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-client-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077570 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-client-certs\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077570 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-tls\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.077736 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.077718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179143 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnr4c\" (UniqueName: \"kubernetes.io/projected/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-kube-api-access-jnr4c\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179277 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179207 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-metrics-server-audit-profiles\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179359 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-audit-log\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179359 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-client-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-client-certs\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-tls\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179651 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.179769 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.179750 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-audit-log\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.180248 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.180222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.180532 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.180508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-metrics-server-audit-profiles\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.181962 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.181943 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-client-certs\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.182059 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.182040 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-client-ca-bundle\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.182193 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.182178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-secret-metrics-server-tls\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.189490 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.189465 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnr4c\" (UniqueName: \"kubernetes.io/projected/12a6d1e2-523c-4752-beb8-b7a2aca1d3c9-kube-api-access-jnr4c\") pod \"metrics-server-7647fcb556-h6fwh\" (UID: \"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9\") " pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.302392 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.302368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:53:57.441967 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:57.441940 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7647fcb556-h6fwh"] Jul 18 02:53:57.444430 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:57.444402 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a6d1e2_523c_4752_beb8_b7a2aca1d3c9.slice/crio-8c8003f2f26788629af91c8752a5b3c20c402781e0d94c43a54f7e8b321df66d WatchSource:0}: Error finding container 8c8003f2f26788629af91c8752a5b3c20c402781e0d94c43a54f7e8b321df66d: Status 404 returned error can't find the container with id 8c8003f2f26788629af91c8752a5b3c20c402781e0d94c43a54f7e8b321df66d Jul 18 02:53:58.083802 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.083763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"8be4a618e071f81a5cab6bec958b6d4b17e13a853dfb59131cd7f855afd84dd7"} Jul 18 02:53:58.084244 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.083851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"f38a177194762e1306c2dd1c09893c29e5f62e4a5f805bfc1f513806e2e1c013"} Jul 18 02:53:58.084244 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.083895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"185c3b665bdbfcd81ec59e15d0569caac7f2d7f2e5421e83f5a2b4ab9f7ecf04"} Jul 18 02:53:58.085032 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.085007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" event={"ID":"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9","Type":"ContainerStarted","Data":"8c8003f2f26788629af91c8752a5b3c20c402781e0d94c43a54f7e8b321df66d"} Jul 18 02:53:58.979387 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.979291 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 02:53:58.989355 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.989324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:58.992425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992232 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 18 02:53:58.992425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992282 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 18 02:53:58.992425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 18 02:53:58.992425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 18 02:53:58.992425 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992380 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2pbvf3jfaj4n0\"" Jul 18 02:53:58.992733 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992522 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 18 02:53:58.992810 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.992796 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 18 02:53:58.993370 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993350 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7vrnw\"" Jul 18 02:53:58.993573 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993557 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 18 02:53:58.993647 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993572 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 18 02:53:58.993698 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993684 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 18 02:53:58.993859 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 18 02:53:58.993954 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 18 02:53:58.994009 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.993898 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 18 02:53:58.994059 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.994024 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 18 02:53:58.995448 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:58.995429 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 18 02:53:59.001967 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.001947 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 02:53:59.092283 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.092247 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"c9a37f7f3437657fb27780b133dfc34ac758045267922da20d24ef9b2b191880"} Jul 18 02:53:59.093848 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093900 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.093995 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.093998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094131 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094315 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvswm\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-kube-api-access-cvswm\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.094598 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.094556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.095453 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.095426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"d72eb7013eaa447dcb7a95d3aa7e5e8b6b071b8c65ac7d7ac87b19d911bdbcb1"} Jul 18 02:53:59.095559 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.095484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"a702502c4dc729e26d924988811d7205160be24d5807864d4248696194070d46"} Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.195991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvswm\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-kube-api-access-cvswm\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.196365 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197102 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.196867 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197470 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.197331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.197470 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.197426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.200471 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.198470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.200471 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.200391 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.201004 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.200979 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.201538 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.201510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612d9d08-0856-49ee-832f-a3745e341c5f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.203476 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.203346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.205193 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.203869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.205519 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.205388 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.206961 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.205683 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.206961 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.205857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.206961 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.206103 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.206961 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.206581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-web-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.206961 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.206801 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/612d9d08-0856-49ee-832f-a3745e341c5f-config-out\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.207242 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.207077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.207242 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.207162 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.207804 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.207758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/612d9d08-0856-49ee-832f-a3745e341c5f-config\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.214101 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.214076 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvswm\" (UniqueName: \"kubernetes.io/projected/612d9d08-0856-49ee-832f-a3745e341c5f-kube-api-access-cvswm\") pod \"prometheus-k8s-0\" (UID: \"612d9d08-0856-49ee-832f-a3745e341c5f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.299539 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.299502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:53:59.447728 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:53:59.447679 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 18 02:53:59.461695 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:53:59.461669 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612d9d08_0856_49ee_832f_a3745e341c5f.slice/crio-40a2a2e7af5a48b10089d2b73b942bf58bcbff5205e62026f993521698e30683 WatchSource:0}: Error finding container 40a2a2e7af5a48b10089d2b73b942bf58bcbff5205e62026f993521698e30683: Status 404 returned error can't find the container with id 40a2a2e7af5a48b10089d2b73b942bf58bcbff5205e62026f993521698e30683 Jul 18 02:54:00.104808 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.104771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"1db8bab20e1cc3e0d7b55161ba6d49bbfe3e8c3ddd1266332ee69ac83970b1d0"} Jul 18 02:54:00.105252 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.104874 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"af1c142219fd039220325e619ed31da5b052ef465da3dffbf5c9469d791388d6"} Jul 18 02:54:00.105252 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.104919 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"8b2f85c37098ee9efc7ccb7d6d417ce3de5648951de1182f967a7ecd4d2d9c0b"} Jul 18 02:54:00.105252 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.104951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"f4e0d5fcfedc76ae2cb7a9fe2e37365b18b0c6ff4ce274fced0b591bb7fa6698"} Jul 18 02:54:00.105252 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.104975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a48491e6-b231-49a5-98ba-7fef835a5e7b","Type":"ContainerStarted","Data":"b08b499adee0594c077700ced9fd1a1140decf4d2d927b5df701c95efbe93134"} Jul 18 02:54:00.107451 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.107428 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" event={"ID":"b0889e23-25b9-47be-bcc1-a8c491f77f29","Type":"ContainerStarted","Data":"bc3e9ddb5d70444fb170fa227a0fdee6fb942b297625ea28cf43c888d8bfd9ac"} Jul 18 02:54:00.107568 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.107548 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:54:00.108888 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.108866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" event={"ID":"12a6d1e2-523c-4752-beb8-b7a2aca1d3c9","Type":"ContainerStarted","Data":"2ba22a2a5041eb39b6151544e21b829c16e8c753a3c75f9eb1c742145d86abeb"} Jul 18 02:54:00.110310 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.110277 2556 generic.go:356] "Generic (PLEG): container finished" podID="612d9d08-0856-49ee-832f-a3745e341c5f" containerID="fb398e6dd3859f2a284c179f767158e3d744be93eb49e6926e5383dec3b5712e" exitCode=0 Jul 18 02:54:00.110387 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.110338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerDied","Data":"fb398e6dd3859f2a284c179f767158e3d744be93eb49e6926e5383dec3b5712e"} Jul 18 02:54:00.110428 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.110394 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"40a2a2e7af5a48b10089d2b73b942bf58bcbff5205e62026f993521698e30683"} Jul 18 02:54:00.133631 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.133578 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.171328467 podStartE2EDuration="7.133558976s" totalImagesPullingTime="2.944210248s" totalInitContainerRuntime="18.020261ms" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:54:00.132472999 +0000 UTC m=+78.123368586" watchObservedRunningTime="2026-07-18 02:54:00.133558976 +0000 UTC m=+78.124454557" Jul 18 02:54:00.158897 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.158851 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" podStartSLOduration=2.890953271 podStartE2EDuration="6.158836183s" totalImagesPullingTime="3.267882912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:54:00.157809714 +0000 UTC m=+78.148705288" watchObservedRunningTime="2026-07-18 02:54:00.158836183 +0000 UTC m=+78.149731757" Jul 18 02:54:00.175229 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:00.175183 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" podStartSLOduration=2.417630193 podStartE2EDuration="4.175167555s" totalImagesPullingTime="1.757537362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:54:00.174446689 +0000 UTC m=+78.165342262" watchObservedRunningTime="2026-07-18 02:54:00.175167555 +0000 UTC m=+78.166063122" Jul 18 02:54:03.128659 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:03.128620 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"3ed9877cb112a5782d10ffac794b828619a178a400b3fc6bcf7cd1168d7fac5b"} Jul 18 02:54:04.136176 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.136143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"8739fd46fcbf0b5ce2bc64011b37a2f9c0edeaaf4fbcac0abddef8c7a371a455"} Jul 18 02:54:04.136582 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.136203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"cdcfcaff9b47028bf41796b55d2eb26637e6209ee35b59264a0ca2a37993a07b"} Jul 18 02:54:04.136582 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.136231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"70d36c160bef6c7ea6fa36003d5fa1032e95fcb25bf36cbab4789fcbbb39bcc0"} Jul 18 02:54:04.136582 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.136254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"be786043fbba4e5016b84557c1d11749676e5a3f55d9e7c4ab044eaef97dcd71"} Jul 18 02:54:04.136582 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.136277 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"612d9d08-0856-49ee-832f-a3745e341c5f","Type":"ContainerStarted","Data":"894af72fa1d100cd93403d4e6aef9b1e3d721f853dd48dffaed877f714651692"} Jul 18 02:54:04.163371 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.163290 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.250604516 podStartE2EDuration="6.163269233s" totalImagesPullingTime="2.895880225s" totalInitContainerRuntime="16.784492ms" isStatefulPod=false podCreationTimestamp="2026-07-18 02:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:54:04.162142374 +0000 UTC m=+82.153037974" watchObservedRunningTime="2026-07-18 02:54:04.163269233 +0000 UTC m=+82.154164806" Jul 18 02:54:04.300143 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:04.300103 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:54:06.122923 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:06.122819 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bd9cb9c44-s48s5" Jul 18 02:54:08.779212 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:08.779176 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:54:17.134518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.134474 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-549dcb6b76-5bf9n" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerName="console" containerID="cri-o://9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17" gracePeriod=15 Jul 18 02:54:17.302769 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.302722 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:54:17.302920 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.302802 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:54:17.910313 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.910273 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:54:17.964699 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964665 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.964699 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964713 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.964943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964774 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.964943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964813 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.964943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964840 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.964943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.964870 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c526q\" (UniqueName: \"kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q\") pod \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\" (UID: \"9cd10d74-b06c-4099-a3a8-c50a8444fd6b\") " Jul 18 02:54:17.965253 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.965227 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config" (OuterVolumeSpecName: "console-config") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:17.965253 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.965237 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:17.965375 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.965356 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:17.967111 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.967085 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:54:17.967378 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.967352 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:54:17.967474 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:17.967389 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q" (OuterVolumeSpecName: "kube-api-access-c526q") pod "9cd10d74-b06c-4099-a3a8-c50a8444fd6b" (UID: "9cd10d74-b06c-4099-a3a8-c50a8444fd6b"). InnerVolumeSpecName "kube-api-access-c526q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:54:18.066369 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066341 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-service-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.066369 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066369 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.066546 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066381 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-oauth-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.066546 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066391 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c526q\" (UniqueName: \"kubernetes.io/projected/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-kube-api-access-c526q\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.066546 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066400 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.066546 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.066409 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cd10d74-b06c-4099-a3a8-c50a8444fd6b-console-oauth-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:18.189017 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.188978 2556 generic.go:356] "Generic (PLEG): container finished" podID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerID="9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17" exitCode=0 Jul 18 02:54:18.189440 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.189022 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-549dcb6b76-5bf9n" Jul 18 02:54:18.189440 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.189055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-549dcb6b76-5bf9n" event={"ID":"9cd10d74-b06c-4099-a3a8-c50a8444fd6b","Type":"ContainerDied","Data":"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17"} Jul 18 02:54:18.189440 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.189098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-549dcb6b76-5bf9n" event={"ID":"9cd10d74-b06c-4099-a3a8-c50a8444fd6b","Type":"ContainerDied","Data":"b312533c0b2c2f55f7f97f3ebbdb0cf8e6691fa5f7be7156865129d657436743"} Jul 18 02:54:18.189440 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.189123 2556 scope.go:117] "RemoveContainer" containerID="9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17" Jul 18 02:54:18.198996 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.198976 2556 scope.go:117] "RemoveContainer" containerID="9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17" Jul 18 02:54:18.199283 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:54:18.199263 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17\": container with ID starting with 9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17 not found: ID does not exist" containerID="9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17" Jul 18 02:54:18.199419 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.199292 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17"} err="failed to get container status \"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17\": rpc error: code = NotFound desc = could not find container \"9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17\": container with ID starting with 9ac5829abc74bb61cde5f485a4d23bc39eef553f295d46cb463badb078eb2e17 not found: ID does not exist" Jul 18 02:54:18.210942 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.210918 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:54:18.215473 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.215454 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-549dcb6b76-5bf9n"] Jul 18 02:54:18.491957 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:18.491873 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" path="/var/lib/kubelet/pods/9cd10d74-b06c-4099-a3a8-c50a8444fd6b/volumes" Jul 18 02:54:24.055776 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:24.055743 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-crs2k" Jul 18 02:54:33.800562 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:33.800499 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6854f75857-qlpmc" podUID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" containerName="console" containerID="cri-o://c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610" gracePeriod=15 Jul 18 02:54:34.053805 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.053746 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:54:34.192100 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192069 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prkjq\" (UniqueName: \"kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192108 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192175 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192208 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192361 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192340 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192403 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192382 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192456 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192412 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert\") pod \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\" (UID: \"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2\") " Jul 18 02:54:34.192819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192631 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:34.192819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192662 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:34.192819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192757 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config" (OuterVolumeSpecName: "console-config") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:34.192819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.192777 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:54:34.194830 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.194800 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq" (OuterVolumeSpecName: "kube-api-access-prkjq") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "kube-api-access-prkjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:54:34.194830 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.194805 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:54:34.194945 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.194870 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" (UID: "fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:54:34.249070 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.249042 2556 generic.go:356] "Generic (PLEG): container finished" podID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" containerID="c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610" exitCode=0 Jul 18 02:54:34.249153 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.249088 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6854f75857-qlpmc" Jul 18 02:54:34.249153 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.249133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6854f75857-qlpmc" event={"ID":"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2","Type":"ContainerDied","Data":"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610"} Jul 18 02:54:34.249232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.249179 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6854f75857-qlpmc" event={"ID":"fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2","Type":"ContainerDied","Data":"15be9ab8428a6095288cb5d28cacfb38e9058dc0e227674a01764650a81833f9"} Jul 18 02:54:34.249232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.249200 2556 scope.go:117] "RemoveContainer" containerID="c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610" Jul 18 02:54:34.261611 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.261593 2556 scope.go:117] "RemoveContainer" containerID="c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610" Jul 18 02:54:34.261848 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:54:34.261830 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610\": container with ID starting with c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610 not found: ID does not exist" containerID="c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610" Jul 18 02:54:34.261904 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.261857 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610"} err="failed to get container status \"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610\": rpc error: code = NotFound desc = could not find container \"c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610\": container with ID starting with c9bd063e6ea4d63e11c315714dd7c52462966ae44cc8cd2dee03258c57f6a610 not found: ID does not exist" Jul 18 02:54:34.269797 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.269779 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:54:34.273034 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.273015 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6854f75857-qlpmc"] Jul 18 02:54:34.293112 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293091 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-trusted-ca-bundle\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293112 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293110 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-service-ca\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293204 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293121 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-oauth-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293204 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293129 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-oauth-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293204 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293138 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-config\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293204 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293146 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-console-serving-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.293204 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.293154 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prkjq\" (UniqueName: \"kubernetes.io/projected/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2-kube-api-access-prkjq\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:54:34.492369 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:34.492283 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" path="/var/lib/kubelet/pods/fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2/volumes" Jul 18 02:54:37.308350 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:37.308318 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:54:37.311992 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:37.311974 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7647fcb556-h6fwh" Jul 18 02:54:59.299878 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:59.299840 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:54:59.320207 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:59.320185 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:54:59.363333 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:54:59.363284 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 18 02:55:17.031506 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031458 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-866774fcd6-zp96r"] Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031753 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerName="console" Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031763 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerName="console" Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031771 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" containerName="console" Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031776 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" containerName="console" Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031830 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd10d74-b06c-4099-a3a8-c50a8444fd6b" containerName="console" Jul 18 02:55:17.031973 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.031839 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba8b396-54f9-4cfc-8ef8-22e2c0ef60a2" containerName="console" Jul 18 02:55:17.033797 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.033782 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.036386 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.036365 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9qgw2\"" Jul 18 02:55:17.036863 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.036848 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 18 02:55:17.036968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.036882 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 18 02:55:17.036968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.036911 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 18 02:55:17.036968 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.036956 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 18 02:55:17.037481 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.037466 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 18 02:55:17.042645 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.042628 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 18 02:55:17.049145 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.049126 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-866774fcd6-zp96r"] Jul 18 02:55:17.110504 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzdf\" (UniqueName: \"kubernetes.io/projected/b1f35e5a-c834-4549-8413-f72b87765b7b-kube-api-access-qvzdf\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110622 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110622 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-metrics-client-ca\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110736 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110736 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-serving-certs-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110809 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-federate-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110809 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.110809 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.110790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.211928 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.211899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.211933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.211960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzdf\" (UniqueName: \"kubernetes.io/projected/b1f35e5a-c834-4549-8413-f72b87765b7b-kube-api-access-qvzdf\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.211983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-metrics-client-ca\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212069 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-serving-certs-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212404 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-federate-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-metrics-client-ca\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.212941 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212918 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-serving-certs-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.213014 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.212993 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.214540 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.214521 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.214688 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.214663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-federate-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.214736 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.214720 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.214783 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.214770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b1f35e5a-c834-4549-8413-f72b87765b7b-telemeter-client-tls\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.221347 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.221325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzdf\" (UniqueName: \"kubernetes.io/projected/b1f35e5a-c834-4549-8413-f72b87765b7b-kube-api-access-qvzdf\") pod \"telemeter-client-866774fcd6-zp96r\" (UID: \"b1f35e5a-c834-4549-8413-f72b87765b7b\") " pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.343283 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.343240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" Jul 18 02:55:17.472491 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:17.472464 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-866774fcd6-zp96r"] Jul 18 02:55:17.474346 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:55:17.474314 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f35e5a_c834_4549_8413_f72b87765b7b.slice/crio-267a64fd841daf0c5039626e94497d76fa0c8570f0637eb88e8c8ed4f38b896c WatchSource:0}: Error finding container 267a64fd841daf0c5039626e94497d76fa0c8570f0637eb88e8c8ed4f38b896c: Status 404 returned error can't find the container with id 267a64fd841daf0c5039626e94497d76fa0c8570f0637eb88e8c8ed4f38b896c Jul 18 02:55:18.417798 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:18.417755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" event={"ID":"b1f35e5a-c834-4549-8413-f72b87765b7b","Type":"ContainerStarted","Data":"267a64fd841daf0c5039626e94497d76fa0c8570f0637eb88e8c8ed4f38b896c"} Jul 18 02:55:19.422956 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:19.422886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" event={"ID":"b1f35e5a-c834-4549-8413-f72b87765b7b","Type":"ContainerStarted","Data":"14ce292a80943e7d5e3f123ca50fec83ccda3bebcbe7e6e774d7ed8f3eacdc01"} Jul 18 02:55:19.422956 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:19.422939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" event={"ID":"b1f35e5a-c834-4549-8413-f72b87765b7b","Type":"ContainerStarted","Data":"1cdf942c1deaac831a99797b9a4c1713048ffef0a0a780d752353510d9c45361"} Jul 18 02:55:19.422956 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:19.422956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" event={"ID":"b1f35e5a-c834-4549-8413-f72b87765b7b","Type":"ContainerStarted","Data":"ba47009dacfe75e183ce2ce1f10876ecc03c544a97151057e7b23cf9bc2c3a23"} Jul 18 02:55:19.446214 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:55:19.446166 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-866774fcd6-zp96r" podStartSLOduration=0.850976465 podStartE2EDuration="2.44615235s" totalImagesPullingTime="1.595175885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:55:19.444980959 +0000 UTC m=+157.435876529" watchObservedRunningTime="2026-07-18 02:55:19.44615235 +0000 UTC m=+157.437047928" Jul 18 02:57:08.017007 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.016933 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq"] Jul 18 02:57:08.020024 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.020009 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.023064 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.023046 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fxv65\"" Jul 18 02:57:08.023173 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.023080 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 02:57:08.023438 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.023422 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 02:57:08.029269 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.029249 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq"] Jul 18 02:57:08.114532 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.114503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.114627 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.114538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsxbd\" (UniqueName: \"kubernetes.io/projected/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-kube-api-access-zsxbd\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.215566 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.215543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.215655 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.215569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsxbd\" (UniqueName: \"kubernetes.io/projected/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-kube-api-access-zsxbd\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.215871 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.215853 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.223849 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.223819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsxbd\" (UniqueName: \"kubernetes.io/projected/b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e-kube-api-access-zsxbd\") pod \"openshift-lws-operator-fd8ccff4c-9vkbq\" (UID: \"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.340676 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.340656 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" Jul 18 02:57:08.463758 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.463735 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq"] Jul 18 02:57:08.465577 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:57:08.465546 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb85bf3fe_79a5_46e1_b7ed_38aa2fa82e3e.slice/crio-c5a58023d2bbb83061bf92228a75189c384a3c7a512d109143371165c796d574 WatchSource:0}: Error finding container c5a58023d2bbb83061bf92228a75189c384a3c7a512d109143371165c796d574: Status 404 returned error can't find the container with id c5a58023d2bbb83061bf92228a75189c384a3c7a512d109143371165c796d574 Jul 18 02:57:08.811717 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:08.811685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" event={"ID":"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e","Type":"ContainerStarted","Data":"c5a58023d2bbb83061bf92228a75189c384a3c7a512d109143371165c796d574"} Jul 18 02:57:11.825948 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:11.825915 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" event={"ID":"b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e","Type":"ContainerStarted","Data":"5e17617b55d9796094c780d9b8acca2e2e2cb8a5fb8c46582b7b2b9fd1dedee9"} Jul 18 02:57:11.851629 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:11.851584 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9vkbq" podStartSLOduration=2.357629619 podStartE2EDuration="4.851566622s" totalImagesPullingTime="2.493937003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:57:11.849533915 +0000 UTC m=+269.840429499" watchObservedRunningTime="2026-07-18 02:57:11.851566622 +0000 UTC m=+269.842462199" Jul 18 02:57:31.342477 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.342446 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch"] Jul 18 02:57:31.345784 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.345765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.348017 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.347994 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 02:57:31.348284 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.348257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hh6fz\"" Jul 18 02:57:31.348417 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.348338 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 02:57:31.348417 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.348338 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 02:57:31.348601 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.348586 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 02:57:31.376963 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.376942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch"] Jul 18 02:57:31.502513 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.502471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-tmp\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.502663 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.502575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-manifests\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.502663 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.502596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.502663 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.502641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz9t2\" (UniqueName: \"kubernetes.io/projected/99d43978-b5c4-4ccc-88e4-dc2d9273833e-kube-api-access-hz9t2\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.502761 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.502674 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604061 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.603992 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-tmp\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604061 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.604044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-manifests\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.604068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.604092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz9t2\" (UniqueName: \"kubernetes.io/projected/99d43978-b5c4-4ccc-88e4-dc2d9273833e-kube-api-access-hz9t2\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604226 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.604128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.604543 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.604510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-manifests\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.606284 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.606260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99d43978-b5c4-4ccc-88e4-dc2d9273833e-tmp\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.606402 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.606385 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.606516 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.606492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99d43978-b5c4-4ccc-88e4-dc2d9273833e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.612381 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.612358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz9t2\" (UniqueName: \"kubernetes.io/projected/99d43978-b5c4-4ccc-88e4-dc2d9273833e-kube-api-access-hz9t2\") pod \"opendatahub-operator-controller-manager-6d4685cdfd-vjqch\" (UID: \"99d43978-b5c4-4ccc-88e4-dc2d9273833e\") " pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.655392 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.655371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:31.832771 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.832747 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch"] Jul 18 02:57:31.833966 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:57:31.833945 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d43978_b5c4_4ccc_88e4_dc2d9273833e.slice/crio-8d85c996137a5058e1c2424cdc7e99eef53da549c5de70bf23e75e2d969daf79 WatchSource:0}: Error finding container 8d85c996137a5058e1c2424cdc7e99eef53da549c5de70bf23e75e2d969daf79: Status 404 returned error can't find the container with id 8d85c996137a5058e1c2424cdc7e99eef53da549c5de70bf23e75e2d969daf79 Jul 18 02:57:31.903806 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:31.903737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" event={"ID":"99d43978-b5c4-4ccc-88e4-dc2d9273833e","Type":"ContainerStarted","Data":"8d85c996137a5058e1c2424cdc7e99eef53da549c5de70bf23e75e2d969daf79"} Jul 18 02:57:34.919832 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:34.919797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" event={"ID":"99d43978-b5c4-4ccc-88e4-dc2d9273833e","Type":"ContainerStarted","Data":"e9a79f61869bf74cc97f77451a9204652f1f3ad810063d576b8621fc8191b426"} Jul 18 02:57:35.925181 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:35.925152 2556 generic.go:356] "Generic (PLEG): container finished" podID="99d43978-b5c4-4ccc-88e4-dc2d9273833e" containerID="e9a79f61869bf74cc97f77451a9204652f1f3ad810063d576b8621fc8191b426" exitCode=0 Jul 18 02:57:35.925536 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:35.925229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" event={"ID":"99d43978-b5c4-4ccc-88e4-dc2d9273833e","Type":"ContainerDied","Data":"e9a79f61869bf74cc97f77451a9204652f1f3ad810063d576b8621fc8191b426"} Jul 18 02:57:36.932663 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:36.932618 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" event={"ID":"99d43978-b5c4-4ccc-88e4-dc2d9273833e","Type":"ContainerStarted","Data":"b05511ea93233c368ac2671f59b7bc4f6b782c33ae42a4f7f0664611c49efa80"} Jul 18 02:57:36.933062 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:36.932765 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:36.962908 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:36.962861 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" podStartSLOduration=1.5652311399999999 podStartE2EDuration="5.962845611s" totalImagesPullingTime="3.346648423s" totalInitContainerRuntime="1.050966048s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:57:36.960954697 +0000 UTC m=+294.951850293" watchObservedRunningTime="2026-07-18 02:57:36.962845611 +0000 UTC m=+294.953741185" Jul 18 02:57:42.387749 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:42.387720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:57:42.391641 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:42.391616 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 02:57:42.395350 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:42.395332 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 02:57:47.938893 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:47.938856 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d4685cdfd-vjqch" Jul 18 02:57:50.941578 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.941539 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm"] Jul 18 02:57:50.943638 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.943622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:50.946612 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.946586 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9e96b6-b9f4-4655-a60f-9377039a87d0-tls-certs\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:50.946716 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.946632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwfcl\" (UniqueName: \"kubernetes.io/projected/de9e96b6-b9f4-4655-a60f-9377039a87d0-kube-api-access-lwfcl\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:50.946764 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.946747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9e96b6-b9f4-4655-a60f-9377039a87d0-tmp\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:50.947643 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.947625 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 18 02:57:50.948476 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.948456 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 02:57:50.948690 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.948454 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2lm9b\"" Jul 18 02:57:50.948819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.948510 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 02:57:50.948877 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.948521 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 18 02:57:50.965145 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:50.965119 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm"] Jul 18 02:57:51.047767 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.047734 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9e96b6-b9f4-4655-a60f-9377039a87d0-tmp\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.047934 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.047798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9e96b6-b9f4-4655-a60f-9377039a87d0-tls-certs\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.047934 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.047831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwfcl\" (UniqueName: \"kubernetes.io/projected/de9e96b6-b9f4-4655-a60f-9377039a87d0-kube-api-access-lwfcl\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.050077 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.050053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9e96b6-b9f4-4655-a60f-9377039a87d0-tmp\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.050449 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.050422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9e96b6-b9f4-4655-a60f-9377039a87d0-tls-certs\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.066366 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.066340 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwfcl\" (UniqueName: \"kubernetes.io/projected/de9e96b6-b9f4-4655-a60f-9377039a87d0-kube-api-access-lwfcl\") pod \"kube-auth-proxy-6bd6b8cb8d-wvwtm\" (UID: \"de9e96b6-b9f4-4655-a60f-9377039a87d0\") " pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.253023 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.252930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" Jul 18 02:57:51.409797 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.409771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm"] Jul 18 02:57:51.411937 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:57:51.411907 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9e96b6_b9f4_4655_a60f_9377039a87d0.slice/crio-ffb1442b6017846afdcecb7ea1698c55316354271b1d4dd53eff642f0f8b3111 WatchSource:0}: Error finding container ffb1442b6017846afdcecb7ea1698c55316354271b1d4dd53eff642f0f8b3111: Status 404 returned error can't find the container with id ffb1442b6017846afdcecb7ea1698c55316354271b1d4dd53eff642f0f8b3111 Jul 18 02:57:51.413897 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.413878 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 02:57:51.995865 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:51.995833 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" event={"ID":"de9e96b6-b9f4-4655-a60f-9377039a87d0","Type":"ContainerStarted","Data":"ffb1442b6017846afdcecb7ea1698c55316354271b1d4dd53eff642f0f8b3111"} Jul 18 02:57:52.304193 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.304160 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5gm86"] Jul 18 02:57:52.321988 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.321956 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5gm86"] Jul 18 02:57:52.322141 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.322056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.326261 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.326234 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 18 02:57:52.326485 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.326281 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7qqc5\"" Jul 18 02:57:52.356883 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.356854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwf77\" (UniqueName: \"kubernetes.io/projected/2c75ff74-ba68-428a-879f-6ffc35260de3-kube-api-access-bwf77\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.357039 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.356912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.458198 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.458160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.458378 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.458237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwf77\" (UniqueName: \"kubernetes.io/projected/2c75ff74-ba68-428a-879f-6ffc35260de3-kube-api-access-bwf77\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.458378 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:57:52.458335 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 18 02:57:52.458460 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:57:52.458400 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs podName:2c75ff74-ba68-428a-879f-6ffc35260de3 nodeName:}" failed. No retries permitted until 2026-07-18 02:57:52.958382147 +0000 UTC m=+310.949277700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs") pod "model-serving-api-54d89bd5fc-5gm86" (UID: "2c75ff74-ba68-428a-879f-6ffc35260de3") : secret "model-serving-api-tls" not found Jul 18 02:57:52.472852 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.472827 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwf77\" (UniqueName: \"kubernetes.io/projected/2c75ff74-ba68-428a-879f-6ffc35260de3-kube-api-access-bwf77\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.595371 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.593639 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:57:52.598937 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.598912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.601703 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.601682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gj5rh\"" Jul 18 02:57:52.601969 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.601951 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 18 02:57:52.602034 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.601951 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 18 02:57:52.602034 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.601989 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 18 02:57:52.602034 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.601994 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 02:57:52.610387 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.610369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:57:52.659351 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659321 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-667zl\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659499 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659499 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659606 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659606 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659705 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.659767 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.659746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760706 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760913 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760913 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-667zl\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760913 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760913 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.760913 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.761157 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.760944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.761681 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.761631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.764525 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.764436 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.764811 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.764786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.765024 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.765004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.765544 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.765519 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.774210 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.774180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.774352 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.774313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-667zl\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl\") pod \"istiod-openshift-gateway-7574459656-zwwb5\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.908613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.908522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:52.962671 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.962634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:52.966704 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:52.966640 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c75ff74-ba68-428a-879f-6ffc35260de3-tls-certs\") pod \"model-serving-api-54d89bd5fc-5gm86\" (UID: \"2c75ff74-ba68-428a-879f-6ffc35260de3\") " pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:53.073936 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:53.073905 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:57:53.076211 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:57:53.076063 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da5482b_27af_4cee_9bc5_f1ebfb0c2408.slice/crio-5db751f44de90cd75dba9b30ab6917a61d030861c49373f72b544e5fc2fb682c WatchSource:0}: Error finding container 5db751f44de90cd75dba9b30ab6917a61d030861c49373f72b544e5fc2fb682c: Status 404 returned error can't find the container with id 5db751f44de90cd75dba9b30ab6917a61d030861c49373f72b544e5fc2fb682c Jul 18 02:57:53.237605 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:53.237517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:53.382370 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:53.382342 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5gm86"] Jul 18 02:57:53.961408 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:57:53.961372 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c75ff74_ba68_428a_879f_6ffc35260de3.slice/crio-2da078479cd78dcf28b187194bd670eda4a0da3f247c1f6e8667a7941eff6696 WatchSource:0}: Error finding container 2da078479cd78dcf28b187194bd670eda4a0da3f247c1f6e8667a7941eff6696: Status 404 returned error can't find the container with id 2da078479cd78dcf28b187194bd670eda4a0da3f247c1f6e8667a7941eff6696 Jul 18 02:57:54.006855 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:54.006826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" event={"ID":"2c75ff74-ba68-428a-879f-6ffc35260de3","Type":"ContainerStarted","Data":"2da078479cd78dcf28b187194bd670eda4a0da3f247c1f6e8667a7941eff6696"} Jul 18 02:57:54.008282 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:54.008245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" event={"ID":"5da5482b-27af-4cee-9bc5-f1ebfb0c2408","Type":"ContainerStarted","Data":"5db751f44de90cd75dba9b30ab6917a61d030861c49373f72b544e5fc2fb682c"} Jul 18 02:57:55.014594 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:55.014547 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" event={"ID":"de9e96b6-b9f4-4655-a60f-9377039a87d0","Type":"ContainerStarted","Data":"855b0382e0e98be21a1a815b2afdf857b1d59147ade4ead6212892092d2e4ecb"} Jul 18 02:57:55.033826 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:55.033761 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bd6b8cb8d-wvwtm" podStartSLOduration=2.440327253 podStartE2EDuration="5.033741209s" totalImagesPullingTime="2.593413956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:57:55.032336819 +0000 UTC m=+313.023232395" watchObservedRunningTime="2026-07-18 02:57:55.033741209 +0000 UTC m=+313.024636784" Jul 18 02:57:56.341236 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:56.341192 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 02:57:56.341562 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:56.341280 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 02:57:57.028840 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.028791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" event={"ID":"5da5482b-27af-4cee-9bc5-f1ebfb0c2408","Type":"ContainerStarted","Data":"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f"} Jul 18 02:57:57.031450 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.031421 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:57:57.032345 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.032313 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-zwwb5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:57:57.032464 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.032372 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:57:57.034356 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.034322 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" event={"ID":"2c75ff74-ba68-428a-879f-6ffc35260de3","Type":"ContainerStarted","Data":"5fc7c02f46b0658961b65a414d639e11909e4296b47fc2c9314bd47a547628b2"} Jul 18 02:57:57.034549 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.034519 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:57:57.056509 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.056442 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" podStartSLOduration=1.793972323 podStartE2EDuration="5.056422189s" totalImagesPullingTime="3.262449866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:57:57.055279394 +0000 UTC m=+315.046174970" watchObservedRunningTime="2026-07-18 02:57:57.056422189 +0000 UTC m=+315.047317765" Jul 18 02:57:57.079632 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:57.079582 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" podStartSLOduration=2.7016092069999997 podStartE2EDuration="5.079567514s" totalImagesPullingTime="2.377958307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:57:57.078757383 +0000 UTC m=+315.069652957" watchObservedRunningTime="2026-07-18 02:57:57.079567514 +0000 UTC m=+315.070463087" Jul 18 02:57:58.039101 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:57:58.039073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:58:00.464185 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.464150 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz"] Jul 18 02:58:00.467761 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.467741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.485906 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.485883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz"] Jul 18 02:58:00.533870 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.533837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.533870 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.533872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.534071 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.533963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.534071 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.533996 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8sn\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-kube-api-access-kp8sn\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.534156 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.534088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.534156 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.534110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.534232 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.534157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.634918 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.634867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.634918 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.634915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.634955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.634972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8sn\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-kube-api-access-kp8sn\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.635026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.635050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.635084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.635818 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.635791 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.637229 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.637202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.637368 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.637351 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.637634 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.637617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.637674 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.637657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.646519 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.646497 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8sn\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-kube-api-access-kp8sn\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.647046 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.647028 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98a61b5c-5a13-4cec-aedb-9e3f577d1c91-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kggtz\" (UID: \"98a61b5c-5a13-4cec-aedb-9e3f577d1c91\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.776983 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.776900 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:00.939399 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.939370 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz"] Jul 18 02:58:00.947249 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:58:00.947220 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a61b5c_5a13_4cec_aedb_9e3f577d1c91.slice/crio-8ae3bc3ca584bb8e1c15351e66e54d3696b87dc788f25e84cec05119ef2b4e02 WatchSource:0}: Error finding container 8ae3bc3ca584bb8e1c15351e66e54d3696b87dc788f25e84cec05119ef2b4e02: Status 404 returned error can't find the container with id 8ae3bc3ca584bb8e1c15351e66e54d3696b87dc788f25e84cec05119ef2b4e02 Jul 18 02:58:00.950313 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.950261 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 02:58:00.950394 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:00.950358 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 02:58:01.054114 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:01.053513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" event={"ID":"98a61b5c-5a13-4cec-aedb-9e3f577d1c91","Type":"ContainerStarted","Data":"ce62c1557ead17558d2dce37d887280cde441c508029bb7f7f3e3354a12988de"} Jul 18 02:58:01.054114 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:01.053578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" event={"ID":"98a61b5c-5a13-4cec-aedb-9e3f577d1c91","Type":"ContainerStarted","Data":"8ae3bc3ca584bb8e1c15351e66e54d3696b87dc788f25e84cec05119ef2b4e02"} Jul 18 02:58:01.054343 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:01.054183 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:01.133523 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:01.133464 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" podStartSLOduration=1.13344756 podStartE2EDuration="1.13344756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:58:01.130154926 +0000 UTC m=+319.121050491" watchObservedRunningTime="2026-07-18 02:58:01.13344756 +0000 UTC m=+319.124343134" Jul 18 02:58:02.065819 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:02.065790 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-kggtz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 02:58:02.066174 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:02.065840 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" podUID="98a61b5c-5a13-4cec-aedb-9e3f577d1c91" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 02:58:03.069141 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.069114 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kggtz" Jul 18 02:58:03.233518 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.233487 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:58:03.233700 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.233676 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerName="discovery" containerID="cri-o://f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f" gracePeriod=30 Jul 18 02:58:03.498549 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.498526 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:58:03.565190 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565163 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565203 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565232 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565255 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565270 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565347 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-667zl\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565390 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565365 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig\") pod \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\" (UID: \"5da5482b-27af-4cee-9bc5-f1ebfb0c2408\") " Jul 18 02:58:03.565689 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.565611 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 02:58:03.567967 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.567922 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl" (OuterVolumeSpecName: "kube-api-access-667zl") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "kube-api-access-667zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:58:03.568080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.567974 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:58:03.568080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.567991 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts" (OuterVolumeSpecName: "cacerts") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:58:03.568080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.568001 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token" (OuterVolumeSpecName: "istio-token") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:58:03.568080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.568014 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 02:58:03.568080 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.568034 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs" (OuterVolumeSpecName: "local-certs") pod "5da5482b-27af-4cee-9bc5-f1ebfb0c2408" (UID: "5da5482b-27af-4cee-9bc5-f1ebfb0c2408"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666494 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-cacerts\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666524 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-ca-configmap\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666534 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-token\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666543 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-667zl\" (UniqueName: \"kubernetes.io/projected/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-kube-api-access-667zl\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666553 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-kubeconfig\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666561 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-istio-csr-dns-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:03.666574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:03.666571 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5da5482b-27af-4cee-9bc5-f1ebfb0c2408-local-certs\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:58:04.073411 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.073374 2556 generic.go:356] "Generic (PLEG): container finished" podID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerID="f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f" exitCode=0 Jul 18 02:58:04.073838 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.073416 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" Jul 18 02:58:04.073838 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.073454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" event={"ID":"5da5482b-27af-4cee-9bc5-f1ebfb0c2408","Type":"ContainerDied","Data":"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f"} Jul 18 02:58:04.073838 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.073500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5" event={"ID":"5da5482b-27af-4cee-9bc5-f1ebfb0c2408","Type":"ContainerDied","Data":"5db751f44de90cd75dba9b30ab6917a61d030861c49373f72b544e5fc2fb682c"} Jul 18 02:58:04.073838 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.073521 2556 scope.go:117] "RemoveContainer" containerID="f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f" Jul 18 02:58:04.082537 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.082520 2556 scope.go:117] "RemoveContainer" containerID="f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f" Jul 18 02:58:04.082799 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:58:04.082781 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f\": container with ID starting with f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f not found: ID does not exist" containerID="f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f" Jul 18 02:58:04.082853 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.082804 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f"} err="failed to get container status \"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f\": rpc error: code = NotFound desc = could not find container \"f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f\": container with ID starting with f1655d2f118fcbab462ce4181ac44e2db6c63234fec2a8aa54909b3718d31c4f not found: ID does not exist" Jul 18 02:58:04.100977 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.100957 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:58:04.114065 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.114042 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zwwb5"] Jul 18 02:58:04.493010 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:04.492920 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" path="/var/lib/kubelet/pods/5da5482b-27af-4cee-9bc5-f1ebfb0c2408/volumes" Jul 18 02:58:08.042488 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:08.042456 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5gm86" Jul 18 02:58:51.867125 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.867087 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjwbj"] Jul 18 02:58:51.867584 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.867429 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerName="discovery" Jul 18 02:58:51.867584 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.867440 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerName="discovery" Jul 18 02:58:51.867584 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.867495 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da5482b-27af-4cee-9bc5-f1ebfb0c2408" containerName="discovery" Jul 18 02:58:51.870043 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.870026 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:58:51.875400 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.875313 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cxrzv\"" Jul 18 02:58:51.875400 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.875316 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 02:58:51.875400 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.875316 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 02:58:51.888668 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.888634 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjwbj"] Jul 18 02:58:51.990869 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:51.990833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvbs\" (UniqueName: \"kubernetes.io/projected/04430df3-c4d7-4c7f-a663-c17b05904939-kube-api-access-spvbs\") pod \"kuadrant-operator-catalog-hjwbj\" (UID: \"04430df3-c4d7-4c7f-a663-c17b05904939\") " pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:58:52.091622 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:52.091587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvbs\" (UniqueName: \"kubernetes.io/projected/04430df3-c4d7-4c7f-a663-c17b05904939-kube-api-access-spvbs\") pod \"kuadrant-operator-catalog-hjwbj\" (UID: \"04430df3-c4d7-4c7f-a663-c17b05904939\") " pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:58:52.100818 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:52.100792 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvbs\" (UniqueName: \"kubernetes.io/projected/04430df3-c4d7-4c7f-a663-c17b05904939-kube-api-access-spvbs\") pod \"kuadrant-operator-catalog-hjwbj\" (UID: \"04430df3-c4d7-4c7f-a663-c17b05904939\") " pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:58:52.179870 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:52.179795 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:58:52.308690 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:52.308658 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hjwbj"] Jul 18 02:58:52.311999 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:58:52.311971 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04430df3_c4d7_4c7f_a663_c17b05904939.slice/crio-d7be6827975772f19ab886f70a1cb50dd1918221c5402110c03384db834daf17 WatchSource:0}: Error finding container d7be6827975772f19ab886f70a1cb50dd1918221c5402110c03384db834daf17: Status 404 returned error can't find the container with id d7be6827975772f19ab886f70a1cb50dd1918221c5402110c03384db834daf17 Jul 18 02:58:53.289201 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:53.289166 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" event={"ID":"04430df3-c4d7-4c7f-a663-c17b05904939","Type":"ContainerStarted","Data":"d7be6827975772f19ab886f70a1cb50dd1918221c5402110c03384db834daf17"} Jul 18 02:58:55.298675 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:55.298638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" event={"ID":"04430df3-c4d7-4c7f-a663-c17b05904939","Type":"ContainerStarted","Data":"0301946423d000f700f0a866a89f1d2757f7a4865085b034e428d814985b7afd"} Jul 18 02:58:55.317635 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:58:55.317585 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" podStartSLOduration=2.332198131 podStartE2EDuration="4.317569703s" totalImagesPullingTime="1.985371572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:58:55.315781136 +0000 UTC m=+373.306676710" watchObservedRunningTime="2026-07-18 02:58:55.317569703 +0000 UTC m=+373.308465278" Jul 18 02:59:02.180074 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:02.180033 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:59:02.180595 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:02.180098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:59:02.202419 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:02.202393 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:59:02.350389 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:02.350363 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hjwbj" Jul 18 02:59:22.692545 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.692443 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7"] Jul 18 02:59:22.697607 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.697580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:22.700682 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.700658 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cfkk8\"" Jul 18 02:59:22.702505 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.702487 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 18 02:59:22.712322 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.712285 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7"] Jul 18 02:59:22.752160 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.752128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gskdc\" (UniqueName: \"kubernetes.io/projected/19e414e9-aef8-4d53-bac7-d25bda7e659c-kube-api-access-gskdc\") pod \"dns-operator-controller-manager-864dd78c4c-zdhw7\" (UID: \"19e414e9-aef8-4d53-bac7-d25bda7e659c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:22.852900 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.852859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gskdc\" (UniqueName: \"kubernetes.io/projected/19e414e9-aef8-4d53-bac7-d25bda7e659c-kube-api-access-gskdc\") pod \"dns-operator-controller-manager-864dd78c4c-zdhw7\" (UID: \"19e414e9-aef8-4d53-bac7-d25bda7e659c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:22.866631 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:22.866600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gskdc\" (UniqueName: \"kubernetes.io/projected/19e414e9-aef8-4d53-bac7-d25bda7e659c-kube-api-access-gskdc\") pod \"dns-operator-controller-manager-864dd78c4c-zdhw7\" (UID: \"19e414e9-aef8-4d53-bac7-d25bda7e659c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:23.008146 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:23.008047 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:23.142760 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:23.142736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7"] Jul 18 02:59:23.145192 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:23.145168 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e414e9_aef8_4d53_bac7_d25bda7e659c.slice/crio-1790ba9b92b693f2ebaeb184b71b77654b807ad6255c870110962455875baad6 WatchSource:0}: Error finding container 1790ba9b92b693f2ebaeb184b71b77654b807ad6255c870110962455875baad6: Status 404 returned error can't find the container with id 1790ba9b92b693f2ebaeb184b71b77654b807ad6255c870110962455875baad6 Jul 18 02:59:23.420104 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:23.420065 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" event={"ID":"19e414e9-aef8-4d53-bac7-d25bda7e659c","Type":"ContainerStarted","Data":"1790ba9b92b693f2ebaeb184b71b77654b807ad6255c870110962455875baad6"} Jul 18 02:59:25.432346 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:25.432313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" event={"ID":"19e414e9-aef8-4d53-bac7-d25bda7e659c","Type":"ContainerStarted","Data":"acfc5d63093099f976b50895a7e9bde3fb23373c42cb2009e32628c782ddd2a4"} Jul 18 02:59:25.432646 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:25.432385 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:25.452277 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:25.452232 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" podStartSLOduration=1.232482933 podStartE2EDuration="3.452216714s" totalImagesPullingTime="2.219733781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:25.451200765 +0000 UTC m=+403.442096340" watchObservedRunningTime="2026-07-18 02:59:25.452216714 +0000 UTC m=+403.443112287" Jul 18 02:59:26.523989 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.523954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt"] Jul 18 02:59:26.527392 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.527370 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:26.530117 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.530093 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m87t7\"" Jul 18 02:59:26.547286 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.547251 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt"] Jul 18 02:59:26.587278 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.587246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtpjg\" (UniqueName: \"kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg\") pod \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" (UID: \"094bc3f0-d789-4b82-845c-a4a7f23cfd84\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:26.688530 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.688495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtpjg\" (UniqueName: \"kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg\") pod \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" (UID: \"094bc3f0-d789-4b82-845c-a4a7f23cfd84\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:26.698776 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.698743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtpjg\" (UniqueName: \"kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg\") pod \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" (UID: \"094bc3f0-d789-4b82-845c-a4a7f23cfd84\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:26.837895 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.837858 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:26.964522 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:26.964498 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt"] Jul 18 02:59:26.966842 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:26.966813 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094bc3f0_d789_4b82_845c_a4a7f23cfd84.slice/crio-aa6f90728c32fbf322f77a9a98d51594edb8132e246b7ebc9816212c85d66afb WatchSource:0}: Error finding container aa6f90728c32fbf322f77a9a98d51594edb8132e246b7ebc9816212c85d66afb: Status 404 returned error can't find the container with id aa6f90728c32fbf322f77a9a98d51594edb8132e246b7ebc9816212c85d66afb Jul 18 02:59:27.442023 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:27.441986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" event={"ID":"094bc3f0-d789-4b82-845c-a4a7f23cfd84","Type":"ContainerStarted","Data":"aa6f90728c32fbf322f77a9a98d51594edb8132e246b7ebc9816212c85d66afb"} Jul 18 02:59:29.455270 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:29.455234 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" event={"ID":"094bc3f0-d789-4b82-845c-a4a7f23cfd84","Type":"ContainerStarted","Data":"70ae1a578c9bb1c6432b66fbfedec4c2670b4e13a2bdb844a95362a25b54cf33"} Jul 18 02:59:29.455768 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:29.455364 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:29.527914 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:29.527861 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" podStartSLOduration=1.89512144 podStartE2EDuration="3.52784508s" totalImagesPullingTime="1.63272364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:29.52599196 +0000 UTC m=+407.516887533" watchObservedRunningTime="2026-07-18 02:59:29.52784508 +0000 UTC m=+407.518740654" Jul 18 02:59:32.519634 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.519594 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt"] Jul 18 02:59:32.524119 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.524096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.526574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.526553 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mz6fd\"" Jul 18 02:59:32.534756 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.534733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt"] Jul 18 02:59:32.640011 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.639971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmhb\" (UniqueName: \"kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.640181 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.640058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.740861 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.740825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.741024 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.740894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmhb\" (UniqueName: \"kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.741213 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.741192 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.752251 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.752223 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmhb\" (UniqueName: \"kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.834042 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.834011 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:32.971811 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:32.971784 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt"] Jul 18 02:59:32.973032 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:32.973005 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a60ac8c_3f96_415c_8857_078bdb897b57.slice/crio-5291c838d64ff189b1dedc7957b44c74f5f7c3268a2fa120b50727161ff35c57 WatchSource:0}: Error finding container 5291c838d64ff189b1dedc7957b44c74f5f7c3268a2fa120b50727161ff35c57: Status 404 returned error can't find the container with id 5291c838d64ff189b1dedc7957b44c74f5f7c3268a2fa120b50727161ff35c57 Jul 18 02:59:33.474358 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:33.474318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" event={"ID":"0a60ac8c-3f96-415c-8857-078bdb897b57","Type":"ContainerStarted","Data":"5291c838d64ff189b1dedc7957b44c74f5f7c3268a2fa120b50727161ff35c57"} Jul 18 02:59:36.440027 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:36.439997 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zdhw7" Jul 18 02:59:37.141862 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.141827 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j"] Jul 18 02:59:37.145613 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.145586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:37.148721 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.148697 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2zqpf\"" Jul 18 02:59:37.158950 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.158924 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j"] Jul 18 02:59:37.286935 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.286894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwqk9\" (UniqueName: \"kubernetes.io/projected/68f87cd5-8df9-41f2-8013-71a5b84206b3-kube-api-access-fwqk9\") pod \"authorino-operator-75cc8d5cb7-t4w4j\" (UID: \"68f87cd5-8df9-41f2-8013-71a5b84206b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:37.388477 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.388441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwqk9\" (UniqueName: \"kubernetes.io/projected/68f87cd5-8df9-41f2-8013-71a5b84206b3-kube-api-access-fwqk9\") pod \"authorino-operator-75cc8d5cb7-t4w4j\" (UID: \"68f87cd5-8df9-41f2-8013-71a5b84206b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:37.399263 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.399189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwqk9\" (UniqueName: \"kubernetes.io/projected/68f87cd5-8df9-41f2-8013-71a5b84206b3-kube-api-access-fwqk9\") pod \"authorino-operator-75cc8d5cb7-t4w4j\" (UID: \"68f87cd5-8df9-41f2-8013-71a5b84206b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:37.459033 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.458994 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:37.623422 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:37.623399 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j"] Jul 18 02:59:37.623957 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:37.623935 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f87cd5_8df9_41f2_8013_71a5b84206b3.slice/crio-614d942049efbf37369aef4a9ff5c23c4ab18dfc22d3242d99d4f637b47e22df WatchSource:0}: Error finding container 614d942049efbf37369aef4a9ff5c23c4ab18dfc22d3242d99d4f637b47e22df: Status 404 returned error can't find the container with id 614d942049efbf37369aef4a9ff5c23c4ab18dfc22d3242d99d4f637b47e22df Jul 18 02:59:38.500873 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:38.500830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" event={"ID":"68f87cd5-8df9-41f2-8013-71a5b84206b3","Type":"ContainerStarted","Data":"614d942049efbf37369aef4a9ff5c23c4ab18dfc22d3242d99d4f637b47e22df"} Jul 18 02:59:38.502945 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:38.502914 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" event={"ID":"0a60ac8c-3f96-415c-8857-078bdb897b57","Type":"ContainerStarted","Data":"a41ea637bb9673b7a2bec55d3557c7eb8596720b200f3a248fa45cb013e2bd8d"} Jul 18 02:59:38.503197 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:38.503148 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:38.529877 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:38.529664 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" podStartSLOduration=1.9570673840000001 podStartE2EDuration="6.529648061s" totalImagesPullingTime="4.572580677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:38.526038288 +0000 UTC m=+416.516933863" watchObservedRunningTime="2026-07-18 02:59:38.529648061 +0000 UTC m=+416.520543635" Jul 18 02:59:40.462285 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:40.462253 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:40.515943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:40.515908 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" event={"ID":"68f87cd5-8df9-41f2-8013-71a5b84206b3","Type":"ContainerStarted","Data":"adb5e917b2fd821e413b431bf2f1429c9981b4639e036475ba5c904363a2c1b5"} Jul 18 02:59:40.516113 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:40.516008 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:40.556092 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:40.556044 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" podStartSLOduration=1.2970051470000001 podStartE2EDuration="3.556029397s" totalImagesPullingTime="2.25902425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:40.554757046 +0000 UTC m=+418.545652620" watchObservedRunningTime="2026-07-18 02:59:40.556029397 +0000 UTC m=+418.546925045" Jul 18 02:59:49.511559 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:49.511528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.282854 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.282817 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt"] Jul 18 02:59:51.283273 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.283009 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" containerName="manager" containerID="cri-o://a41ea637bb9673b7a2bec55d3557c7eb8596720b200f3a248fa45cb013e2bd8d" gracePeriod=2 Jul 18 02:59:51.287516 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.287479 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.288929 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.288899 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt"] Jul 18 02:59:51.318132 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.318080 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 02:59:51.318581 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.318555 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" containerName="manager" Jul 18 02:59:51.318683 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.318586 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" containerName="manager" Jul 18 02:59:51.318683 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.318679 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" containerName="manager" Jul 18 02:59:51.321684 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.321669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.334172 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.334145 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt"] Jul 18 02:59:51.334417 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.334386 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" containerName="manager" containerID="cri-o://70ae1a578c9bb1c6432b66fbfedec4c2670b4e13a2bdb844a95362a25b54cf33" gracePeriod=2 Jul 18 02:59:51.345981 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.345946 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279"] Jul 18 02:59:51.349207 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.349178 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 02:59:51.349455 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.349259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.356129 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.356107 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt"] Jul 18 02:59:51.370801 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.370776 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279"] Jul 18 02:59:51.372574 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.372551 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2"] Jul 18 02:59:51.373103 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.373082 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" containerName="manager" Jul 18 02:59:51.373239 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.373126 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" containerName="manager" Jul 18 02:59:51.373239 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.373227 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" containerName="manager" Jul 18 02:59:51.375759 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.375732 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.376476 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.376457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:51.377910 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.377884 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.380848 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.380823 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.389449 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.389425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2"] Jul 18 02:59:51.415994 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.415965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9nxc\" (UniqueName: \"kubernetes.io/projected/34a3806a-9b87-4c03-9502-46e083bcd989-kube-api-access-h9nxc\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.416115 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.416102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm9wf\" (UniqueName: \"kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.416196 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.416133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.416196 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.416167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34a3806a-9b87-4c03-9502-46e083bcd989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.423671 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.423602 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.425741 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.425713 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.516935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm9wf\" (UniqueName: \"kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.516981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.517013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34a3806a-9b87-4c03-9502-46e083bcd989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.517036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstx8\" (UniqueName: \"kubernetes.io/projected/65190831-f5a0-4d57-a4f2-ea8ddc151e67-kube-api-access-zstx8\") pod \"limitador-operator-controller-manager-859d7b78bd-9h5r2\" (UID: \"65190831-f5a0-4d57-a4f2-ea8ddc151e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.517104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9nxc\" (UniqueName: \"kubernetes.io/projected/34a3806a-9b87-4c03-9502-46e083bcd989-kube-api-access-h9nxc\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.517401 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.517368 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.517702 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.517459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34a3806a-9b87-4c03-9502-46e083bcd989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.522326 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.522278 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t4w4j" Jul 18 02:59:51.524917 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.524887 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.529447 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.529423 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm9wf\" (UniqueName: \"kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h9cp6\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.530048 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.530027 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9nxc\" (UniqueName: \"kubernetes.io/projected/34a3806a-9b87-4c03-9502-46e083bcd989-kube-api-access-h9nxc\") pod \"kuadrant-operator-controller-manager-86878c769f-sb279\" (UID: \"34a3806a-9b87-4c03-9502-46e083bcd989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.551971 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.551940 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.568191 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.568057 2556 generic.go:356] "Generic (PLEG): container finished" podID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" containerID="70ae1a578c9bb1c6432b66fbfedec4c2670b4e13a2bdb844a95362a25b54cf33" exitCode=0 Jul 18 02:59:51.570599 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.570497 2556 generic.go:356] "Generic (PLEG): container finished" podID="0a60ac8c-3f96-415c-8857-078bdb897b57" containerID="a41ea637bb9673b7a2bec55d3557c7eb8596720b200f3a248fa45cb013e2bd8d" exitCode=0 Jul 18 02:59:51.570769 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.570637 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5291c838d64ff189b1dedc7957b44c74f5f7c3268a2fa120b50727161ff35c57" Jul 18 02:59:51.573582 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.573560 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.575975 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.575943 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.576072 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.576005 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.581936 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.581913 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.586631 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.586605 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:51.588756 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:51.588732 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:51.618216 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.618190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstx8\" (UniqueName: \"kubernetes.io/projected/65190831-f5a0-4d57-a4f2-ea8ddc151e67-kube-api-access-zstx8\") pod \"limitador-operator-controller-manager-859d7b78bd-9h5r2\" (UID: \"65190831-f5a0-4d57-a4f2-ea8ddc151e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:51.631870 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.631843 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstx8\" (UniqueName: \"kubernetes.io/projected/65190831-f5a0-4d57-a4f2-ea8ddc151e67-kube-api-access-zstx8\") pod \"limitador-operator-controller-manager-859d7b78bd-9h5r2\" (UID: \"65190831-f5a0-4d57-a4f2-ea8ddc151e67\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:51.713859 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.713831 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:51.718866 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.718846 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtpjg\" (UniqueName: \"kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg\") pod \"094bc3f0-d789-4b82-845c-a4a7f23cfd84\" (UID: \"094bc3f0-d789-4b82-845c-a4a7f23cfd84\") " Jul 18 02:59:51.718943 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.718894 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbmhb\" (UniqueName: \"kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb\") pod \"0a60ac8c-3f96-415c-8857-078bdb897b57\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " Jul 18 02:59:51.719001 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.718982 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume\") pod \"0a60ac8c-3f96-415c-8857-078bdb897b57\" (UID: \"0a60ac8c-3f96-415c-8857-078bdb897b57\") " Jul 18 02:59:51.719341 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.719314 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a60ac8c-3f96-415c-8857-078bdb897b57" (UID: "0a60ac8c-3f96-415c-8857-078bdb897b57"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 02:59:51.720317 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.720282 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:51.721089 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.721062 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg" (OuterVolumeSpecName: "kube-api-access-qtpjg") pod "094bc3f0-d789-4b82-845c-a4a7f23cfd84" (UID: "094bc3f0-d789-4b82-845c-a4a7f23cfd84"). InnerVolumeSpecName "kube-api-access-qtpjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:59:51.721161 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.721069 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb" (OuterVolumeSpecName: "kube-api-access-mbmhb") pod "0a60ac8c-3f96-415c-8857-078bdb897b57" (UID: "0a60ac8c-3f96-415c-8857-078bdb897b57"). InnerVolumeSpecName "kube-api-access-mbmhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 02:59:51.727029 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.727006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:51.820730 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.820664 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtpjg\" (UniqueName: \"kubernetes.io/projected/094bc3f0-d789-4b82-845c-a4a7f23cfd84-kube-api-access-qtpjg\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:59:51.820730 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.820697 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbmhb\" (UniqueName: \"kubernetes.io/projected/0a60ac8c-3f96-415c-8857-078bdb897b57-kube-api-access-mbmhb\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:59:51.820730 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.820714 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a60ac8c-3f96-415c-8857-078bdb897b57-extensions-socket-volume\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 02:59:51.863816 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:51.863788 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 02:59:51.865596 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:51.865571 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd331a21f_7cfa_470d_ac3f_f07df70570c5.slice/crio-984f65ac5d78d0617515bb9fe51b1130de6bdc88c378e5b29c06c26af3313916 WatchSource:0}: Error finding container 984f65ac5d78d0617515bb9fe51b1130de6bdc88c378e5b29c06c26af3313916: Status 404 returned error can't find the container with id 984f65ac5d78d0617515bb9fe51b1130de6bdc88c378e5b29c06c26af3313916 Jul 18 02:59:52.132185 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:52.132150 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65190831_f5a0_4d57_a4f2_ea8ddc151e67.slice/crio-51d9e0fdc6b788f1c8b7a6e72f4929d56088888188ee639ba5bbf1a194cc11ff WatchSource:0}: Error finding container 51d9e0fdc6b788f1c8b7a6e72f4929d56088888188ee639ba5bbf1a194cc11ff: Status 404 returned error can't find the container with id 51d9e0fdc6b788f1c8b7a6e72f4929d56088888188ee639ba5bbf1a194cc11ff Jul 18 02:59:52.132737 ip-10-0-130-116 kubenswrapper[2556]: W0718 02:59:52.132713 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a3806a_9b87_4c03_9502_46e083bcd989.slice/crio-e57bb476197f89e547f41dc6294e9f7b0512a6e54264d1d2ca2a7b8673828e4a WatchSource:0}: Error finding container e57bb476197f89e547f41dc6294e9f7b0512a6e54264d1d2ca2a7b8673828e4a: Status 404 returned error can't find the container with id e57bb476197f89e547f41dc6294e9f7b0512a6e54264d1d2ca2a7b8673828e4a Jul 18 02:59:52.133010 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.132984 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2"] Jul 18 02:59:52.134822 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.134799 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279"] Jul 18 02:59:52.493515 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:52.493431 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kr5vt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:52.495370 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.495347 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" path="/var/lib/kubelet/pods/094bc3f0-d789-4b82-845c-a4a7f23cfd84/volumes" Jul 18 02:59:52.495630 ip-10-0-130-116 kubenswrapper[2556]: E0718 02:59:52.495605 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jsrlt\" is forbidden: User \"system:node:ip-10-0-130-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-116.ec2.internal' and this object" podUID="094bc3f0-d789-4b82-845c-a4a7f23cfd84" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:52.495712 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.495699 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a60ac8c-3f96-415c-8857-078bdb897b57" path="/var/lib/kubelet/pods/0a60ac8c-3f96-415c-8857-078bdb897b57/volumes" Jul 18 02:59:52.576848 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.576804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" event={"ID":"34a3806a-9b87-4c03-9502-46e083bcd989","Type":"ContainerStarted","Data":"1b0d721584c38056c36f564655b111a7a61feb3d13d00ad75415633de4b27a75"} Jul 18 02:59:52.577038 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.576954 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 02:59:52.577038 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.576994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" event={"ID":"34a3806a-9b87-4c03-9502-46e083bcd989","Type":"ContainerStarted","Data":"e57bb476197f89e547f41dc6294e9f7b0512a6e54264d1d2ca2a7b8673828e4a"} Jul 18 02:59:52.578362 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.578335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" event={"ID":"d331a21f-7cfa-470d-ac3f-f07df70570c5","Type":"ContainerStarted","Data":"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97"} Jul 18 02:59:52.578478 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.578386 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 02:59:52.578478 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.578404 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" event={"ID":"d331a21f-7cfa-470d-ac3f-f07df70570c5","Type":"ContainerStarted","Data":"984f65ac5d78d0617515bb9fe51b1130de6bdc88c378e5b29c06c26af3313916"} Jul 18 02:59:52.585764 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.585730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" event={"ID":"65190831-f5a0-4d57-a4f2-ea8ddc151e67","Type":"ContainerStarted","Data":"4607cbf60a31e6e1f7b6903fd91bbd4f0ab5055fee9d607052683b2848d1a1e8"} Jul 18 02:59:52.585904 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.585816 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 02:59:52.585904 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.585839 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" event={"ID":"65190831-f5a0-4d57-a4f2-ea8ddc151e67","Type":"ContainerStarted","Data":"51d9e0fdc6b788f1c8b7a6e72f4929d56088888188ee639ba5bbf1a194cc11ff"} Jul 18 02:59:52.587001 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.586970 2556 scope.go:117] "RemoveContainer" containerID="70ae1a578c9bb1c6432b66fbfedec4c2670b4e13a2bdb844a95362a25b54cf33" Jul 18 02:59:52.587001 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.586983 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jsrlt" Jul 18 02:59:52.587152 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.586976 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kr5vt" Jul 18 02:59:52.612799 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.612752 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" podStartSLOduration=1.612734568 podStartE2EDuration="1.612734568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:52.606279621 +0000 UTC m=+430.597175195" watchObservedRunningTime="2026-07-18 02:59:52.612734568 +0000 UTC m=+430.603630142" Jul 18 02:59:52.634271 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.634229 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" podStartSLOduration=1.634214287 podStartE2EDuration="1.634214287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:52.632812491 +0000 UTC m=+430.623708067" watchObservedRunningTime="2026-07-18 02:59:52.634214287 +0000 UTC m=+430.625109863" Jul 18 02:59:52.664686 ip-10-0-130-116 kubenswrapper[2556]: I0718 02:59:52.664640 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" podStartSLOduration=1.664624653 podStartE2EDuration="1.664624653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:59:52.662586551 +0000 UTC m=+430.653482125" watchObservedRunningTime="2026-07-18 02:59:52.664624653 +0000 UTC m=+430.655520227" Jul 18 03:00:03.595807 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.595773 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9h5r2" Jul 18 03:00:03.596229 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.595856 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 03:00:03.596229 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.596050 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sb279" Jul 18 03:00:03.715669 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.715635 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 03:00:03.715879 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.715852 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" podUID="d331a21f-7cfa-470d-ac3f-f07df70570c5" containerName="manager" containerID="cri-o://dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97" gracePeriod=10 Jul 18 03:00:03.955288 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:03.955265 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 03:00:04.131895 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.131867 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm9wf\" (UniqueName: \"kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf\") pod \"d331a21f-7cfa-470d-ac3f-f07df70570c5\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " Jul 18 03:00:04.132040 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.131931 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume\") pod \"d331a21f-7cfa-470d-ac3f-f07df70570c5\" (UID: \"d331a21f-7cfa-470d-ac3f-f07df70570c5\") " Jul 18 03:00:04.132314 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.132273 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d331a21f-7cfa-470d-ac3f-f07df70570c5" (UID: "d331a21f-7cfa-470d-ac3f-f07df70570c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:00:04.133800 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.133745 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf" (OuterVolumeSpecName: "kube-api-access-xm9wf") pod "d331a21f-7cfa-470d-ac3f-f07df70570c5" (UID: "d331a21f-7cfa-470d-ac3f-f07df70570c5"). InnerVolumeSpecName "kube-api-access-xm9wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:00:04.233164 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.233138 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm9wf\" (UniqueName: \"kubernetes.io/projected/d331a21f-7cfa-470d-ac3f-f07df70570c5-kube-api-access-xm9wf\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:00:04.233164 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.233163 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d331a21f-7cfa-470d-ac3f-f07df70570c5-extensions-socket-volume\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:00:04.644736 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.644703 2556 generic.go:356] "Generic (PLEG): container finished" podID="d331a21f-7cfa-470d-ac3f-f07df70570c5" containerID="dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97" exitCode=0 Jul 18 03:00:04.645183 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.644753 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" Jul 18 03:00:04.645183 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.644786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" event={"ID":"d331a21f-7cfa-470d-ac3f-f07df70570c5","Type":"ContainerDied","Data":"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97"} Jul 18 03:00:04.645183 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.644837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6" event={"ID":"d331a21f-7cfa-470d-ac3f-f07df70570c5","Type":"ContainerDied","Data":"984f65ac5d78d0617515bb9fe51b1130de6bdc88c378e5b29c06c26af3313916"} Jul 18 03:00:04.645183 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.644859 2556 scope.go:117] "RemoveContainer" containerID="dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97" Jul 18 03:00:04.653210 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.653192 2556 scope.go:117] "RemoveContainer" containerID="dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97" Jul 18 03:00:04.653475 ip-10-0-130-116 kubenswrapper[2556]: E0718 03:00:04.653458 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97\": container with ID starting with dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97 not found: ID does not exist" containerID="dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97" Jul 18 03:00:04.653537 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.653483 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97"} err="failed to get container status \"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97\": rpc error: code = NotFound desc = could not find container \"dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97\": container with ID starting with dc21018f0f963146c41eb82de7d6116462a75998fed4c81d3ece76c9eed20b97 not found: ID does not exist" Jul 18 03:00:04.682315 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.682251 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 03:00:04.688195 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:04.688175 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h9cp6"] Jul 18 03:00:06.493531 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:06.493496 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d331a21f-7cfa-470d-ac3f-f07df70570c5" path="/var/lib/kubelet/pods/d331a21f-7cfa-470d-ac3f-f07df70570c5/volumes" Jul 18 03:00:22.417886 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.417849 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:22.418252 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.418238 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d331a21f-7cfa-470d-ac3f-f07df70570c5" containerName="manager" Jul 18 03:00:22.418252 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.418250 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d331a21f-7cfa-470d-ac3f-f07df70570c5" containerName="manager" Jul 18 03:00:22.418355 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.418343 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d331a21f-7cfa-470d-ac3f-f07df70570c5" containerName="manager" Jul 18 03:00:22.422937 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.422914 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.426782 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.426761 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n487r\"" Jul 18 03:00:22.427282 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.427269 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 03:00:22.434509 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.434489 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:22.478880 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.478850 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.479029 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.478897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxzx\" (UniqueName: \"kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.532845 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.532814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:22.580171 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.580133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.580354 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.580183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxzx\" (UniqueName: \"kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.581016 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.580980 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.602986 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.602950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxzx\" (UniqueName: \"kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx\") pod \"limitador-limitador-64c94fd64f-tc7fx\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.733884 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.733803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:22.869314 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:22.869276 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:22.871349 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:00:22.871318 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193c6a6b_1945_42af_ba49_6b329cc4f66f.slice/crio-cc23772296410081cef6dc8b5a0574f3f78b112a82e86a4d96e6da75dd9edcee WatchSource:0}: Error finding container cc23772296410081cef6dc8b5a0574f3f78b112a82e86a4d96e6da75dd9edcee: Status 404 returned error can't find the container with id cc23772296410081cef6dc8b5a0574f3f78b112a82e86a4d96e6da75dd9edcee Jul 18 03:00:23.741729 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:23.741639 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" event={"ID":"193c6a6b-1945-42af-ba49-6b329cc4f66f","Type":"ContainerStarted","Data":"cc23772296410081cef6dc8b5a0574f3f78b112a82e86a4d96e6da75dd9edcee"} Jul 18 03:00:25.753335 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:25.753281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" event={"ID":"193c6a6b-1945-42af-ba49-6b329cc4f66f","Type":"ContainerStarted","Data":"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579"} Jul 18 03:00:25.753781 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:25.753376 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:25.772056 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:25.772007 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" podStartSLOduration=1.109423352 podStartE2EDuration="3.771991566s" totalImagesPullingTime="2.662568214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:00:25.771256764 +0000 UTC m=+463.762152339" watchObservedRunningTime="2026-07-18 03:00:25.771991566 +0000 UTC m=+463.762887139" Jul 18 03:00:36.760076 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:36.760047 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:38.276719 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.276683 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:38.277122 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.276897 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" podUID="193c6a6b-1945-42af-ba49-6b329cc4f66f" containerName="limitador" containerID="cri-o://44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579" gracePeriod=30 Jul 18 03:00:38.817558 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.817535 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:38.817689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.817596 2556 generic.go:356] "Generic (PLEG): container finished" podID="193c6a6b-1945-42af-ba49-6b329cc4f66f" containerID="44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579" exitCode=0 Jul 18 03:00:38.817689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.817628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" event={"ID":"193c6a6b-1945-42af-ba49-6b329cc4f66f","Type":"ContainerDied","Data":"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579"} Jul 18 03:00:38.817689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.817667 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" event={"ID":"193c6a6b-1945-42af-ba49-6b329cc4f66f","Type":"ContainerDied","Data":"cc23772296410081cef6dc8b5a0574f3f78b112a82e86a4d96e6da75dd9edcee"} Jul 18 03:00:38.817689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.817687 2556 scope.go:117] "RemoveContainer" containerID="44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579" Jul 18 03:00:38.825476 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.825455 2556 scope.go:117] "RemoveContainer" containerID="44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579" Jul 18 03:00:38.825724 ip-10-0-130-116 kubenswrapper[2556]: E0718 03:00:38.825707 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579\": container with ID starting with 44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579 not found: ID does not exist" containerID="44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579" Jul 18 03:00:38.825795 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.825733 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579"} err="failed to get container status \"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579\": rpc error: code = NotFound desc = could not find container \"44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579\": container with ID starting with 44fa77590ec02defccf573c0a7d53d137b8a9251bcbc53746ce82fb69314d579 not found: ID does not exist" Jul 18 03:00:38.936347 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.936240 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file\") pod \"193c6a6b-1945-42af-ba49-6b329cc4f66f\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " Jul 18 03:00:38.936516 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.936407 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbxzx\" (UniqueName: \"kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx\") pod \"193c6a6b-1945-42af-ba49-6b329cc4f66f\" (UID: \"193c6a6b-1945-42af-ba49-6b329cc4f66f\") " Jul 18 03:00:38.936676 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.936651 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file" (OuterVolumeSpecName: "config-file") pod "193c6a6b-1945-42af-ba49-6b329cc4f66f" (UID: "193c6a6b-1945-42af-ba49-6b329cc4f66f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:00:38.938412 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:38.938387 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx" (OuterVolumeSpecName: "kube-api-access-hbxzx") pod "193c6a6b-1945-42af-ba49-6b329cc4f66f" (UID: "193c6a6b-1945-42af-ba49-6b329cc4f66f"). InnerVolumeSpecName "kube-api-access-hbxzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:00:39.037626 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:39.037591 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbxzx\" (UniqueName: \"kubernetes.io/projected/193c6a6b-1945-42af-ba49-6b329cc4f66f-kube-api-access-hbxzx\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:00:39.037626 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:39.037623 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/193c6a6b-1945-42af-ba49-6b329cc4f66f-config-file\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:00:39.823559 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:39.823532 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tc7fx" Jul 18 03:00:39.848570 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:39.848546 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:39.851751 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:39.851728 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tc7fx"] Jul 18 03:00:40.493445 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:40.493407 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193c6a6b-1945-42af-ba49-6b329cc4f66f" path="/var/lib/kubelet/pods/193c6a6b-1945-42af-ba49-6b329cc4f66f/volumes" Jul 18 03:00:43.997090 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:43.997056 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x"] Jul 18 03:00:43.997619 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:43.997600 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193c6a6b-1945-42af-ba49-6b329cc4f66f" containerName="limitador" Jul 18 03:00:43.997693 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:43.997622 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="193c6a6b-1945-42af-ba49-6b329cc4f66f" containerName="limitador" Jul 18 03:00:43.997757 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:43.997744 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="193c6a6b-1945-42af-ba49-6b329cc4f66f" containerName="limitador" Jul 18 03:00:44.002068 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.002046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.006032 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.006007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 18 03:00:44.006229 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.006212 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 18 03:00:44.006286 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.006214 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qs9wk\"" Jul 18 03:00:44.007123 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.007110 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 18 03:00:44.009822 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.009798 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x"] Jul 18 03:00:44.081607 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.081572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce985d91-029d-4ee9-9759-98f03a78c346-data\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.081762 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.081642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6npql\" (UniqueName: \"kubernetes.io/projected/ce985d91-029d-4ee9-9759-98f03a78c346-kube-api-access-6npql\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.182641 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.182609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6npql\" (UniqueName: \"kubernetes.io/projected/ce985d91-029d-4ee9-9759-98f03a78c346-kube-api-access-6npql\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.182838 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.182696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce985d91-029d-4ee9-9759-98f03a78c346-data\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.183062 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.183040 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ce985d91-029d-4ee9-9759-98f03a78c346-data\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.191166 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.191137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6npql\" (UniqueName: \"kubernetes.io/projected/ce985d91-029d-4ee9-9759-98f03a78c346-kube-api-access-6npql\") pod \"postgres-69fb4594cf-tmk2x\" (UID: \"ce985d91-029d-4ee9-9759-98f03a78c346\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.312754 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.312730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:44.444125 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.444086 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x"] Jul 18 03:00:44.445548 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:00:44.445523 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce985d91_029d_4ee9_9759_98f03a78c346.slice/crio-02f4ab3a55aa4aae59de0cc5e304e2c2a0279df7d19331be067704f83ecb3865 WatchSource:0}: Error finding container 02f4ab3a55aa4aae59de0cc5e304e2c2a0279df7d19331be067704f83ecb3865: Status 404 returned error can't find the container with id 02f4ab3a55aa4aae59de0cc5e304e2c2a0279df7d19331be067704f83ecb3865 Jul 18 03:00:44.847362 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:44.847327 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" event={"ID":"ce985d91-029d-4ee9-9759-98f03a78c346","Type":"ContainerStarted","Data":"02f4ab3a55aa4aae59de0cc5e304e2c2a0279df7d19331be067704f83ecb3865"} Jul 18 03:00:52.891702 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:52.891666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" event={"ID":"ce985d91-029d-4ee9-9759-98f03a78c346","Type":"ContainerStarted","Data":"60089b9395ebe4e1b0f055d9ae5b61a7752615546983c5e18fa6878c73d5473c"} Jul 18 03:00:52.892088 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:52.891741 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:00:52.922788 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:52.922719 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" podStartSLOduration=2.056830666 podStartE2EDuration="9.922699539s" totalImagesPullingTime="7.865868873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:00:52.922450594 +0000 UTC m=+490.913346171" watchObservedRunningTime="2026-07-18 03:00:52.922699539 +0000 UTC m=+490.913595116" Jul 18 03:00:58.925567 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:00:58.925536 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tmk2x" Jul 18 03:01:08.210839 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.210805 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:08.213158 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.213142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.216703 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.216683 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 18 03:01:08.217016 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.217002 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jfjpp\"" Jul 18 03:01:08.217663 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.217650 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 03:01:08.231224 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.231200 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:08.301570 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.301534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.301570 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.301573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg7hh\" (UniqueName: \"kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.402669 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.402631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.402669 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.402670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg7hh\" (UniqueName: \"kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.402873 ip-10-0-130-116 kubenswrapper[2556]: E0718 03:01:08.402795 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 18 03:01:08.402873 ip-10-0-130-116 kubenswrapper[2556]: E0718 03:01:08.402870 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert podName:136365cc-503f-4388-b02a-05bc40e42c2d nodeName:}" failed. No retries permitted until 2026-07-18 03:01:08.902849897 +0000 UTC m=+506.893745455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert") pod "maas-controller-86784c98f4-dq5t2" (UID: "136365cc-503f-4388-b02a-05bc40e42c2d") : secret "maas-controller-webhook-cert" not found Jul 18 03:01:08.413189 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.413165 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg7hh\" (UniqueName: \"kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.418612 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.418588 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b58945879-5swm7"] Jul 18 03:01:08.421478 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.421460 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.431414 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.431390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b58945879-5swm7"] Jul 18 03:01:08.503457 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.503372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de4cc92-8364-4035-8fca-cd7244ab32ea-webhook-cert\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.503457 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.503417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7sk8\" (UniqueName: \"kubernetes.io/projected/3de4cc92-8364-4035-8fca-cd7244ab32ea-kube-api-access-d7sk8\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.604162 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.604124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de4cc92-8364-4035-8fca-cd7244ab32ea-webhook-cert\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.604382 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.604177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7sk8\" (UniqueName: \"kubernetes.io/projected/3de4cc92-8364-4035-8fca-cd7244ab32ea-kube-api-access-d7sk8\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.606533 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.606512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de4cc92-8364-4035-8fca-cd7244ab32ea-webhook-cert\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.613664 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.613643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7sk8\" (UniqueName: \"kubernetes.io/projected/3de4cc92-8364-4035-8fca-cd7244ab32ea-kube-api-access-d7sk8\") pod \"maas-controller-7b58945879-5swm7\" (UID: \"3de4cc92-8364-4035-8fca-cd7244ab32ea\") " pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.731792 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.731757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:08.857818 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.857797 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b58945879-5swm7"] Jul 18 03:01:08.859310 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:01:08.859266 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de4cc92_8364_4035_8fca_cd7244ab32ea.slice/crio-53b8eaa62aed2e6efc7cd80d72b705d9af1a2f20128293c4b836054f7ed02b02 WatchSource:0}: Error finding container 53b8eaa62aed2e6efc7cd80d72b705d9af1a2f20128293c4b836054f7ed02b02: Status 404 returned error can't find the container with id 53b8eaa62aed2e6efc7cd80d72b705d9af1a2f20128293c4b836054f7ed02b02 Jul 18 03:01:08.907857 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.907825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.910058 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.910039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") pod \"maas-controller-86784c98f4-dq5t2\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:08.971070 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:08.971031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b58945879-5swm7" event={"ID":"3de4cc92-8364-4035-8fca-cd7244ab32ea","Type":"ContainerStarted","Data":"53b8eaa62aed2e6efc7cd80d72b705d9af1a2f20128293c4b836054f7ed02b02"} Jul 18 03:01:09.123644 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:09.123606 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:09.263806 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:09.263782 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:09.265525 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:01:09.265500 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136365cc_503f_4388_b02a_05bc40e42c2d.slice/crio-e6e6e7057b3c8c6b50e6e4971af6d5184a3fab39455a1de3be0e23f47c07cfe1 WatchSource:0}: Error finding container e6e6e7057b3c8c6b50e6e4971af6d5184a3fab39455a1de3be0e23f47c07cfe1: Status 404 returned error can't find the container with id e6e6e7057b3c8c6b50e6e4971af6d5184a3fab39455a1de3be0e23f47c07cfe1 Jul 18 03:01:09.979673 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:09.979622 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86784c98f4-dq5t2" event={"ID":"136365cc-503f-4388-b02a-05bc40e42c2d","Type":"ContainerStarted","Data":"e6e6e7057b3c8c6b50e6e4971af6d5184a3fab39455a1de3be0e23f47c07cfe1"} Jul 18 03:01:11.991109 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:11.991020 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b58945879-5swm7" event={"ID":"3de4cc92-8364-4035-8fca-cd7244ab32ea","Type":"ContainerStarted","Data":"ce93ce90ff8a143db84c724630b69f5a77affd1a731ae5f716bf9e9cef62d6a0"} Jul 18 03:01:11.991490 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:11.991194 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:12.017141 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:12.017090 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b58945879-5swm7" podStartSLOduration=1.322930926 podStartE2EDuration="4.017074318s" totalImagesPullingTime="2.694143392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:01:12.014469076 +0000 UTC m=+510.005364650" watchObservedRunningTime="2026-07-18 03:01:12.017074318 +0000 UTC m=+510.007969870" Jul 18 03:01:12.996912 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:12.996876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86784c98f4-dq5t2" event={"ID":"136365cc-503f-4388-b02a-05bc40e42c2d","Type":"ContainerStarted","Data":"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9"} Jul 18 03:01:13.021792 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:13.021733 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86784c98f4-dq5t2" podStartSLOduration=2.080903237 podStartE2EDuration="5.02171377s" totalImagesPullingTime="2.940810533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:01:13.018597603 +0000 UTC m=+511.009493177" watchObservedRunningTime="2026-07-18 03:01:13.02171377 +0000 UTC m=+511.012609351" Jul 18 03:01:14.001588 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:14.001554 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:22.999188 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:22.999150 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b58945879-5swm7" Jul 18 03:01:23.046857 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.046825 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:23.047062 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.047035 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86784c98f4-dq5t2" podUID="136365cc-503f-4388-b02a-05bc40e42c2d" containerName="manager" containerID="cri-o://10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9" gracePeriod=30 Jul 18 03:01:23.048910 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.048883 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:23.293553 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.293530 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:23.440077 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.440040 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg7hh\" (UniqueName: \"kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh\") pod \"136365cc-503f-4388-b02a-05bc40e42c2d\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " Jul 18 03:01:23.440284 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.440157 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") pod \"136365cc-503f-4388-b02a-05bc40e42c2d\" (UID: \"136365cc-503f-4388-b02a-05bc40e42c2d\") " Jul 18 03:01:23.442166 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.442138 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "136365cc-503f-4388-b02a-05bc40e42c2d" (UID: "136365cc-503f-4388-b02a-05bc40e42c2d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:01:23.442281 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.442194 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh" (OuterVolumeSpecName: "kube-api-access-fg7hh") pod "136365cc-503f-4388-b02a-05bc40e42c2d" (UID: "136365cc-503f-4388-b02a-05bc40e42c2d"). InnerVolumeSpecName "kube-api-access-fg7hh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:01:23.540920 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.540829 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/136365cc-503f-4388-b02a-05bc40e42c2d-webhook-cert\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:01:23.540920 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:23.540862 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg7hh\" (UniqueName: \"kubernetes.io/projected/136365cc-503f-4388-b02a-05bc40e42c2d-kube-api-access-fg7hh\") on node \"ip-10-0-130-116.ec2.internal\" DevicePath \"\"" Jul 18 03:01:24.048092 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.048054 2556 generic.go:356] "Generic (PLEG): container finished" podID="136365cc-503f-4388-b02a-05bc40e42c2d" containerID="10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9" exitCode=0 Jul 18 03:01:24.048092 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.048097 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86784c98f4-dq5t2" Jul 18 03:01:24.048572 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.048108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86784c98f4-dq5t2" event={"ID":"136365cc-503f-4388-b02a-05bc40e42c2d","Type":"ContainerDied","Data":"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9"} Jul 18 03:01:24.048572 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.048163 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86784c98f4-dq5t2" event={"ID":"136365cc-503f-4388-b02a-05bc40e42c2d","Type":"ContainerDied","Data":"e6e6e7057b3c8c6b50e6e4971af6d5184a3fab39455a1de3be0e23f47c07cfe1"} Jul 18 03:01:24.048572 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.048193 2556 scope.go:117] "RemoveContainer" containerID="10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9" Jul 18 03:01:24.056688 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.056501 2556 scope.go:117] "RemoveContainer" containerID="10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9" Jul 18 03:01:24.056782 ip-10-0-130-116 kubenswrapper[2556]: E0718 03:01:24.056751 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9\": container with ID starting with 10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9 not found: ID does not exist" containerID="10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9" Jul 18 03:01:24.056841 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.056788 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9"} err="failed to get container status \"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9\": rpc error: code = NotFound desc = could not find container \"10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9\": container with ID starting with 10d3a304bb7525b85f9725a40e168e5f6fdc4cba55aaa8fabf3693d9f9d535c9 not found: ID does not exist" Jul 18 03:01:24.070509 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.070482 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:24.073964 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.073944 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86784c98f4-dq5t2"] Jul 18 03:01:24.493308 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:24.493274 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136365cc-503f-4388-b02a-05bc40e42c2d" path="/var/lib/kubelet/pods/136365cc-503f-4388-b02a-05bc40e42c2d/volumes" Jul 18 03:01:44.096913 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.096872 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-779b555464-ch964"] Jul 18 03:01:44.097369 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.097241 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136365cc-503f-4388-b02a-05bc40e42c2d" containerName="manager" Jul 18 03:01:44.097369 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.097252 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="136365cc-503f-4388-b02a-05bc40e42c2d" containerName="manager" Jul 18 03:01:44.097369 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.097347 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="136365cc-503f-4388-b02a-05bc40e42c2d" containerName="manager" Jul 18 03:01:44.106087 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.106060 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.110097 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.109995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-89rwf\"" Jul 18 03:01:44.110097 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.110023 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 18 03:01:44.113330 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.113287 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-779b555464-ch964"] Jul 18 03:01:44.120841 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.120804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-maas-api-tls\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.120971 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.120870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-openshift-service-ca\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.121023 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.120991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsp4k\" (UniqueName: \"kubernetes.io/projected/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-kube-api-access-rsp4k\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.222474 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.222428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsp4k\" (UniqueName: \"kubernetes.io/projected/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-kube-api-access-rsp4k\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.222689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.222524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-maas-api-tls\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.222689 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.222594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-openshift-service-ca\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.223230 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.223205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-openshift-service-ca\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.224976 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.224952 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-maas-api-tls\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.230713 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.230689 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsp4k\" (UniqueName: \"kubernetes.io/projected/04cab60c-48e5-4fb5-bff4-bb2674b3f2ef-kube-api-access-rsp4k\") pod \"maas-api-779b555464-ch964\" (UID: \"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef\") " pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.418032 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.417952 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:44.571068 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.571041 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-779b555464-ch964"] Jul 18 03:01:44.573246 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:01:44.573220 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cab60c_48e5_4fb5_bff4_bb2674b3f2ef.slice/crio-3c1ad221a5d21c69a165a0eae885f9c852cd9f6f8982d84860e63e85df15c1ab WatchSource:0}: Error finding container 3c1ad221a5d21c69a165a0eae885f9c852cd9f6f8982d84860e63e85df15c1ab: Status 404 returned error can't find the container with id 3c1ad221a5d21c69a165a0eae885f9c852cd9f6f8982d84860e63e85df15c1ab Jul 18 03:01:44.640926 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.640887 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2zkxn"] Jul 18 03:01:44.645107 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.645087 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.648181 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.648159 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lzkvh\"" Jul 18 03:01:44.648524 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.648504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 18 03:01:44.657683 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.657660 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2zkxn"] Jul 18 03:01:44.728709 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.728616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.728884 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.728712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kktzn\" (UniqueName: \"kubernetes.io/projected/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-kube-api-access-kktzn\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.829846 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.829807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.830009 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.829877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kktzn\" (UniqueName: \"kubernetes.io/projected/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-kube-api-access-kktzn\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.830658 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.830634 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.840068 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.840043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kktzn\" (UniqueName: \"kubernetes.io/projected/e14759d5-3ceb-44ff-97db-dc3b06ef8c59-kube-api-access-kktzn\") pod \"payload-processing-5bf47cd988-2zkxn\" (UID: \"e14759d5-3ceb-44ff-97db-dc3b06ef8c59\") " pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:44.957957 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:44.957928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:45.101475 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:45.101447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2zkxn"] Jul 18 03:01:45.103056 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:01:45.103028 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14759d5_3ceb_44ff_97db_dc3b06ef8c59.slice/crio-0e22a6bf57a9d0f1e1c4ebdfc42e6ac52f42bc6d197013a7938d7f23be2e48e7 WatchSource:0}: Error finding container 0e22a6bf57a9d0f1e1c4ebdfc42e6ac52f42bc6d197013a7938d7f23be2e48e7: Status 404 returned error can't find the container with id 0e22a6bf57a9d0f1e1c4ebdfc42e6ac52f42bc6d197013a7938d7f23be2e48e7 Jul 18 03:01:45.149291 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:45.149253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" event={"ID":"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef","Type":"ContainerStarted","Data":"3c1ad221a5d21c69a165a0eae885f9c852cd9f6f8982d84860e63e85df15c1ab"} Jul 18 03:01:45.150365 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:45.150344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" event={"ID":"e14759d5-3ceb-44ff-97db-dc3b06ef8c59","Type":"ContainerStarted","Data":"0e22a6bf57a9d0f1e1c4ebdfc42e6ac52f42bc6d197013a7938d7f23be2e48e7"} Jul 18 03:01:47.162225 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:47.162189 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" event={"ID":"04cab60c-48e5-4fb5-bff4-bb2674b3f2ef","Type":"ContainerStarted","Data":"59fae005416e4d8e56d1c9a9258962eb8bfd734143f6e026a529e2081d6add8b"} Jul 18 03:01:47.162615 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:47.162309 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:01:47.179652 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:47.179597 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" podStartSLOduration=1.6449199700000001 podStartE2EDuration="3.179576783s" totalImagesPullingTime="1.534656813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:01:47.179569759 +0000 UTC m=+545.170465333" watchObservedRunningTime="2026-07-18 03:01:47.179576783 +0000 UTC m=+545.170472360" Jul 18 03:01:50.181606 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:50.181569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" event={"ID":"e14759d5-3ceb-44ff-97db-dc3b06ef8c59","Type":"ContainerStarted","Data":"9874066ae2f4e42aed86592f8693936e3bc8b6092be2a370f78e3e17686ca951"} Jul 18 03:01:50.182036 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:50.181694 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:01:50.198701 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:50.198647 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" podStartSLOduration=1.551441261 podStartE2EDuration="6.198633452s" totalImagesPullingTime="4.647192191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:01:50.197282063 +0000 UTC m=+548.188177639" watchObservedRunningTime="2026-07-18 03:01:50.198633452 +0000 UTC m=+548.189529026" Jul 18 03:01:53.176027 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:01:53.175999 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-779b555464-ch964" Jul 18 03:02:01.189104 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:01.189072 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-2zkxn" Jul 18 03:02:19.788211 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.788168 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w"] Jul 18 03:02:19.791380 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.791347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.794108 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.794083 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 03:02:19.794237 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.794130 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 03:02:19.795328 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.795312 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-992zj\"" Jul 18 03:02:19.795405 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.795318 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 18 03:02:19.807251 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.805662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w"] Jul 18 03:02:19.952116 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.952292 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.952292 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.952426 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.952426 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:19.952426 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:19.952398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbnv2\" (UniqueName: \"kubernetes.io/projected/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-kube-api-access-dbnv2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053415 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053387 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053581 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053581 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053581 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbnv2\" (UniqueName: \"kubernetes.io/projected/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-kube-api-access-dbnv2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053581 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053792 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053900 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053877 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053955 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.053998 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.053957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.055620 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.055598 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.055933 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.055915 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.061765 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.061746 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbnv2\" (UniqueName: \"kubernetes.io/projected/07b75ffe-6db1-4d82-b7a3-8cc1488ba435-kube-api-access-dbnv2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9s56w\" (UID: \"07b75ffe-6db1-4d82-b7a3-8cc1488ba435\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.111370 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.111337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:20.239777 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.239750 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w"] Jul 18 03:02:20.241811 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:02:20.241782 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b75ffe_6db1_4d82_b7a3_8cc1488ba435.slice/crio-1ec83a44fb3c1d03b27d093af3f43467c9407cdabd9b1cb35c974c8220eae518 WatchSource:0}: Error finding container 1ec83a44fb3c1d03b27d093af3f43467c9407cdabd9b1cb35c974c8220eae518: Status 404 returned error can't find the container with id 1ec83a44fb3c1d03b27d093af3f43467c9407cdabd9b1cb35c974c8220eae518 Jul 18 03:02:20.330335 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:20.330248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" event={"ID":"07b75ffe-6db1-4d82-b7a3-8cc1488ba435","Type":"ContainerStarted","Data":"1ec83a44fb3c1d03b27d093af3f43467c9407cdabd9b1cb35c974c8220eae518"} Jul 18 03:02:21.337539 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:21.337506 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" event={"ID":"07b75ffe-6db1-4d82-b7a3-8cc1488ba435","Type":"ContainerStarted","Data":"808aa743ae4cfd734c37d07216ea0cd70a18d879050afb106195ef61a3978aa7"} Jul 18 03:02:21.357585 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:21.357532 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" podStartSLOduration=1.3452548819999999 podStartE2EDuration="2.357516985s" totalImagesPullingTime="1.012262103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:02:21.356467136 +0000 UTC m=+579.347362724" watchObservedRunningTime="2026-07-18 03:02:21.357516985 +0000 UTC m=+579.348412559" Jul 18 03:02:30.112220 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:30.112184 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:30.112606 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:30.112243 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:30.124191 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:30.124168 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:30.391791 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:30.391729 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9s56w" Jul 18 03:02:32.593644 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.593612 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm"] Jul 18 03:02:32.601570 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.601545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.604252 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.604233 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 18 03:02:32.608880 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.608857 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm"] Jul 18 03:02:32.658440 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.658545 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.658545 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658487 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.658617 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4nwb\" (UniqueName: \"kubernetes.io/projected/5dbeee07-d28b-4877-b414-7e8d6d157699-kube-api-access-q4nwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.658658 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbeee07-d28b-4877-b414-7e8d6d157699-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.658698 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.658682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.759939 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.759914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4nwb\" (UniqueName: \"kubernetes.io/projected/5dbeee07-d28b-4877-b414-7e8d6d157699-kube-api-access-q4nwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760038 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.759956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbeee07-d28b-4877-b414-7e8d6d157699-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760038 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.759984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760038 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760038 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760244 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760496 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760475 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760613 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760529 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.760613 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.760554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.762224 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.762204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dbeee07-d28b-4877-b414-7e8d6d157699-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.762376 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.762355 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dbeee07-d28b-4877-b414-7e8d6d157699-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.768079 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.768058 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4nwb\" (UniqueName: \"kubernetes.io/projected/5dbeee07-d28b-4877-b414-7e8d6d157699-kube-api-access-q4nwb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm\" (UID: \"5dbeee07-d28b-4877-b414-7e8d6d157699\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:32.912898 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:32.912838 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:33.042588 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:33.042565 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm"] Jul 18 03:02:33.044875 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:02:33.044846 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbeee07_d28b_4877_b414_7e8d6d157699.slice/crio-f6008b4913a3b72d897a7b400b7131998680378ddcdd3c6237cfab7b21c71f4e WatchSource:0}: Error finding container f6008b4913a3b72d897a7b400b7131998680378ddcdd3c6237cfab7b21c71f4e: Status 404 returned error can't find the container with id f6008b4913a3b72d897a7b400b7131998680378ddcdd3c6237cfab7b21c71f4e Jul 18 03:02:33.395098 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:33.395061 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" event={"ID":"5dbeee07-d28b-4877-b414-7e8d6d157699","Type":"ContainerStarted","Data":"51fd7e1a6f60ea234300c4b2f0a31310f4744b1598094060e1f73db3538f962c"} Jul 18 03:02:33.395233 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:33.395114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" event={"ID":"5dbeee07-d28b-4877-b414-7e8d6d157699","Type":"ContainerStarted","Data":"f6008b4913a3b72d897a7b400b7131998680378ddcdd3c6237cfab7b21c71f4e"} Jul 18 03:02:33.425360 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:33.425314 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" podStartSLOduration=1.239239996 podStartE2EDuration="1.425286808s" totalImagesPullingTime="186.046812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:02:33.422976142 +0000 UTC m=+591.413871728" watchObservedRunningTime="2026-07-18 03:02:33.425286808 +0000 UTC m=+591.416182383" Jul 18 03:02:42.420159 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:42.420130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 03:02:42.424080 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:42.424061 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7qfv_03951d41-340c-4d69-9af4-259adaa04047/ovn-acl-logging/0.log" Jul 18 03:02:42.913575 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:42.913537 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:42.913758 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:42.913638 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:42.926554 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:42.926522 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:02:43.456845 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:02:43.456815 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm" Jul 18 03:04:57.261047 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:57.261014 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b58945879-5swm7_3de4cc92-8364-4035-8fca-cd7244ab32ea/manager/0.log" Jul 18 03:04:57.371662 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:57.371631 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5gm86_2c75ff74-ba68-428a-879f-6ffc35260de3/server/0.log" Jul 18 03:04:57.718632 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:57.718603 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4685cdfd-vjqch_99d43978-b5c4-4ccc-88e4-dc2d9273833e/copy-manifests/0.log" Jul 18 03:04:57.737776 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:57.737746 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4685cdfd-vjqch_99d43978-b5c4-4ccc-88e4-dc2d9273833e/manager/0.log" Jul 18 03:04:58.185775 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:58.185742 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-779b555464-ch964_04cab60c-48e5-4fb5-bff4-bb2674b3f2ef/maas-api/0.log" Jul 18 03:04:58.298903 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:58.298869 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tmk2x_ce985d91-029d-4ee9-9759-98f03a78c346/postgres/0.log" Jul 18 03:04:59.650954 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:59.650921 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t4w4j_68f87cd5-8df9-41f2-8013-71a5b84206b3/manager/0.log" Jul 18 03:04:59.762891 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:59.762857 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zdhw7_19e414e9-aef8-4d53-bac7-d25bda7e659c/manager/0.log" Jul 18 03:04:59.977597 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:04:59.977529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hjwbj_04430df3-c4d7-4c7f-a663-c17b05904939/registry-server/0.log" Jul 18 03:05:00.112001 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:00.111962 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sb279_34a3806a-9b87-4c03-9502-46e083bcd989/manager/0.log" Jul 18 03:05:00.358851 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:00.358799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9h5r2_65190831-f5a0-4d57-a4f2-ea8ddc151e67/manager/0.log" Jul 18 03:05:00.830642 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:00.830608 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kggtz_98a61b5c-5a13-4cec-aedb-9e3f577d1c91/discovery/0.log" Jul 18 03:05:00.935784 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:00.935761 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd6b8cb8d-wvwtm_de9e96b6-b9f4-4655-a60f-9377039a87d0/kube-auth-proxy/0.log" Jul 18 03:05:01.382288 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:01.382257 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2zkxn_e14759d5-3ceb-44ff-97db-dc3b06ef8c59/payload-processing/0.log" Jul 18 03:05:01.931856 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:01.931816 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9s56w_07b75ffe-6db1-4d82-b7a3-8cc1488ba435/main/0.log" Jul 18 03:05:02.149181 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:02.149145 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffhdfm_5dbeee07-d28b-4877-b414-7e8d6d157699/main/0.log" Jul 18 03:05:11.045874 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:11.045848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wmh8j_26f31202-f2d7-4c3c-8343-7a64a7d6899f/global-pull-secret-syncer/0.log" Jul 18 03:05:11.147498 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:11.147471 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s2thn_e819eb0a-9c00-4320-9e66-1166175fb227/konnectivity-agent/0.log" Jul 18 03:05:11.167987 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:11.167955 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-116.ec2.internal_0058f1d7ca6e164db62bc07c21346302/haproxy/0.log" Jul 18 03:05:16.013332 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:16.013278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t4w4j_68f87cd5-8df9-41f2-8013-71a5b84206b3/manager/0.log" Jul 18 03:05:16.074064 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:16.074031 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zdhw7_19e414e9-aef8-4d53-bac7-d25bda7e659c/manager/0.log" Jul 18 03:05:16.154658 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:16.154579 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hjwbj_04430df3-c4d7-4c7f-a663-c17b05904939/registry-server/0.log" Jul 18 03:05:16.218608 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:16.218577 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sb279_34a3806a-9b87-4c03-9502-46e083bcd989/manager/0.log" Jul 18 03:05:16.281834 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:16.281798 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9h5r2_65190831-f5a0-4d57-a4f2-ea8ddc151e67/manager/0.log" Jul 18 03:05:17.880981 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:17.880949 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/alertmanager/0.log" Jul 18 03:05:17.905253 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:17.905229 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/config-reloader/0.log" Jul 18 03:05:17.929118 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:17.929088 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/kube-rbac-proxy-web/0.log" Jul 18 03:05:17.954428 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:17.954402 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/kube-rbac-proxy/0.log" Jul 18 03:05:17.985331 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:17.985287 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/kube-rbac-proxy-metric/0.log" Jul 18 03:05:18.010760 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.010732 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/prom-label-proxy/0.log" Jul 18 03:05:18.036238 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.036164 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a48491e6-b231-49a5-98ba-7fef835a5e7b/init-config-reloader/0.log" Jul 18 03:05:18.215953 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.215927 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7647fcb556-h6fwh_12a6d1e2-523c-4752-beb8-b7a2aca1d3c9/metrics-server/0.log" Jul 18 03:05:18.275051 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.275010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tlzb_a41747ca-a9fc-4114-8948-6896c575a74a/node-exporter/0.log" Jul 18 03:05:18.297869 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.297794 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tlzb_a41747ca-a9fc-4114-8948-6896c575a74a/kube-rbac-proxy/0.log" Jul 18 03:05:18.321758 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.321732 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tlzb_a41747ca-a9fc-4114-8948-6896c575a74a/init-textfile/0.log" Jul 18 03:05:18.500085 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.500057 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4pr2_d2b75127-f076-493a-bca0-795effd4f258/kube-rbac-proxy-main/0.log" Jul 18 03:05:18.526926 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.526900 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4pr2_d2b75127-f076-493a-bca0-795effd4f258/kube-rbac-proxy-self/0.log" Jul 18 03:05:18.546578 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.546555 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-g4pr2_d2b75127-f076-493a-bca0-795effd4f258/openshift-state-metrics/0.log" Jul 18 03:05:18.598634 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.598607 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/prometheus/0.log" Jul 18 03:05:18.616913 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.616884 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/config-reloader/0.log" Jul 18 03:05:18.641813 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.641792 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/thanos-sidecar/0.log" Jul 18 03:05:18.663387 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.663359 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/kube-rbac-proxy-web/0.log" Jul 18 03:05:18.687095 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.687074 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/kube-rbac-proxy/0.log" Jul 18 03:05:18.707989 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.707960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/kube-rbac-proxy-thanos/0.log" Jul 18 03:05:18.729834 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.729807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_612d9d08-0856-49ee-832f-a3745e341c5f/init-config-reloader/0.log" Jul 18 03:05:18.839903 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.839875 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866774fcd6-zp96r_b1f35e5a-c834-4549-8413-f72b87765b7b/telemeter-client/0.log" Jul 18 03:05:18.860639 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.860566 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866774fcd6-zp96r_b1f35e5a-c834-4549-8413-f72b87765b7b/reload/0.log" Jul 18 03:05:18.882014 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.881991 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-866774fcd6-zp96r_b1f35e5a-c834-4549-8413-f72b87765b7b/kube-rbac-proxy/0.log" Jul 18 03:05:18.912016 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.911986 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/thanos-query/0.log" Jul 18 03:05:18.934430 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.934405 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/kube-rbac-proxy-web/0.log" Jul 18 03:05:18.961963 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.961942 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/kube-rbac-proxy/0.log" Jul 18 03:05:18.985451 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:18.985426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/prom-label-proxy/0.log" Jul 18 03:05:19.009323 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:19.009284 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/kube-rbac-proxy-rules/0.log" Jul 18 03:05:19.034352 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:19.034329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bd9cb9c44-s48s5_b0889e23-25b9-47be-bcc1-a8c491f77f29/kube-rbac-proxy-metrics/0.log" Jul 18 03:05:21.057002 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.056970 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv"] Jul 18 03:05:21.060744 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.060723 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.063290 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.063267 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dw4tm\"/\"kube-root-ca.crt\"" Jul 18 03:05:21.064283 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.064263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dw4tm\"/\"default-dockercfg-56gg6\"" Jul 18 03:05:21.064372 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.064278 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dw4tm\"/\"openshift-service-ca.crt\"" Jul 18 03:05:21.068370 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.068351 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv"] Jul 18 03:05:21.178218 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.178191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-lib-modules\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.178401 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.178226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-podres\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.178401 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.178255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dhq\" (UniqueName: \"kubernetes.io/projected/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-kube-api-access-b6dhq\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.178401 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.178274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-sys\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.178401 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.178341 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-proc\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279577 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-lib-modules\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279740 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-podres\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279740 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dhq\" (UniqueName: \"kubernetes.io/projected/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-kube-api-access-b6dhq\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279740 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-sys\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279740 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-lib-modules\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279740 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-sys\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279937 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-podres\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279937 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-proc\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.279937 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.279883 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-proc\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.289346 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.289316 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dhq\" (UniqueName: \"kubernetes.io/projected/db9d3e4c-2c9b-477d-bbdf-6a291822c8b5-kube-api-access-b6dhq\") pod \"perf-node-gather-daemonset-cqhvv\" (UID: \"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5\") " pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.372495 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.372408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:21.502277 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:21.502250 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv"] Jul 18 03:05:21.505337 ip-10-0-130-116 kubenswrapper[2556]: W0718 03:05:21.505285 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb9d3e4c_2c9b_477d_bbdf_6a291822c8b5.slice/crio-23c37821a847313d5b3b913ac24493b055eb803861885493ae1dfd6ddcaee818 WatchSource:0}: Error finding container 23c37821a847313d5b3b913ac24493b055eb803861885493ae1dfd6ddcaee818: Status 404 returned error can't find the container with id 23c37821a847313d5b3b913ac24493b055eb803861885493ae1dfd6ddcaee818 Jul 18 03:05:22.208626 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:22.208595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" event={"ID":"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5","Type":"ContainerStarted","Data":"f9398222fcc9e46484d39f887ed6eb9bdbd4767d585f4c317f13d98b22244f90"} Jul 18 03:05:22.208995 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:22.208644 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" event={"ID":"db9d3e4c-2c9b-477d-bbdf-6a291822c8b5","Type":"ContainerStarted","Data":"23c37821a847313d5b3b913ac24493b055eb803861885493ae1dfd6ddcaee818"} Jul 18 03:05:22.208995 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:22.208726 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:22.230497 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:22.230433 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" podStartSLOduration=1.230418481 podStartE2EDuration="1.230418481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:05:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:05:22.228052495 +0000 UTC m=+760.218948069" watchObservedRunningTime="2026-07-18 03:05:22.230418481 +0000 UTC m=+760.221314118" Jul 18 03:05:23.223316 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:23.223276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkgld_98010d94-80b4-4d8f-95f2-b7759976b6d7/dns/0.log" Jul 18 03:05:23.243480 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:23.243455 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkgld_98010d94-80b4-4d8f-95f2-b7759976b6d7/kube-rbac-proxy/0.log" Jul 18 03:05:23.309923 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:23.309898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26jvp_4035f302-88b2-4527-9bcd-424b00cd5de2/dns-node-resolver/0.log" Jul 18 03:05:24.004072 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:24.004035 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tcjbm_afbddab1-fbe8-4b76-b3ec-ba176e3223c2/node-ca/0.log" Jul 18 03:05:25.000384 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:25.000355 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kggtz_98a61b5c-5a13-4cec-aedb-9e3f577d1c91/discovery/0.log" Jul 18 03:05:25.020189 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:25.020164 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd6b8cb8d-wvwtm_de9e96b6-b9f4-4655-a60f-9377039a87d0/kube-auth-proxy/0.log" Jul 18 03:05:25.131314 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:25.131275 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2zkxn_e14759d5-3ceb-44ff-97db-dc3b06ef8c59/payload-processing/0.log" Jul 18 03:05:25.765658 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:25.765624 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ft88p_651775d8-6881-4c80-8822-69e0f717189c/serve-healthcheck-canary/0.log" Jul 18 03:05:26.413643 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:26.413597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cf7mj_3669befa-3869-43cd-b14b-ed64b25154e8/kube-rbac-proxy/0.log" Jul 18 03:05:26.434836 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:26.434804 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cf7mj_3669befa-3869-43cd-b14b-ed64b25154e8/exporter/0.log" Jul 18 03:05:26.455349 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:26.455315 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cf7mj_3669befa-3869-43cd-b14b-ed64b25154e8/extractor/0.log" Jul 18 03:05:28.222977 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:28.222950 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dw4tm/perf-node-gather-daemonset-cqhvv" Jul 18 03:05:28.609484 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:28.609448 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b58945879-5swm7_3de4cc92-8364-4035-8fca-cd7244ab32ea/manager/0.log" Jul 18 03:05:28.636474 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:28.636446 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5gm86_2c75ff74-ba68-428a-879f-6ffc35260de3/server/0.log" Jul 18 03:05:28.792470 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:28.792442 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4685cdfd-vjqch_99d43978-b5c4-4ccc-88e4-dc2d9273833e/manager/0.log" Jul 18 03:05:28.812641 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:28.812618 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d4685cdfd-vjqch_99d43978-b5c4-4ccc-88e4-dc2d9273833e/copy-manifests/0.log" Jul 18 03:05:30.238864 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:30.238833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9vkbq_b85bf3fe-79a5-46e1-b7ed-38aa2fa82e3e/openshift-lws-operator/0.log" Jul 18 03:05:30.994675 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:30.994597 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kggtz_98a61b5c-5a13-4cec-aedb-9e3f577d1c91/discovery/0.log" Jul 18 03:05:31.004539 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:31.004515 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd6b8cb8d-wvwtm_de9e96b6-b9f4-4655-a60f-9377039a87d0/kube-auth-proxy/0.log" Jul 18 03:05:31.074243 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:31.074217 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2zkxn_e14759d5-3ceb-44ff-97db-dc3b06ef8c59/payload-processing/0.log" Jul 18 03:05:32.164403 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:32.164372 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kggtz_98a61b5c-5a13-4cec-aedb-9e3f577d1c91/discovery/0.log" Jul 18 03:05:32.179204 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:32.179173 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd6b8cb8d-wvwtm_de9e96b6-b9f4-4655-a60f-9377039a87d0/kube-auth-proxy/0.log" Jul 18 03:05:32.254096 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:32.254009 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2zkxn_e14759d5-3ceb-44ff-97db-dc3b06ef8c59/payload-processing/0.log" Jul 18 03:05:36.558845 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.558811 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/kube-multus-additional-cni-plugins/0.log" Jul 18 03:05:36.578374 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.578341 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/egress-router-binary-copy/0.log" Jul 18 03:05:36.597972 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.597942 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/cni-plugins/0.log" Jul 18 03:05:36.616690 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.616663 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/bond-cni-plugin/0.log" Jul 18 03:05:36.636434 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.636411 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/routeoverride-cni/0.log" Jul 18 03:05:36.658654 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.658627 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/whereabouts-cni-bincopy/0.log" Jul 18 03:05:36.679733 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:36.679709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlcq_307595ab-24b7-4800-a2cc-cc39c6b289fd/whereabouts-cni/0.log" Jul 18 03:05:37.023598 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:37.023570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v9rvx_1d78fc5d-c305-41e4-a68b-6dd18c318c54/kube-multus/0.log" Jul 18 03:05:37.118607 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:37.118526 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-df4d4_16fbfead-eeb6-4383-b009-3ca4e8ce62d5/network-metrics-daemon/0.log" Jul 18 03:05:37.136389 ip-10-0-130-116 kubenswrapper[2556]: I0718 03:05:37.136356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-df4d4_16fbfead-eeb6-4383-b009-3ca4e8ce62d5/kube-rbac-proxy/0.log"