Jul 07 14:34:16.942416 ip-10-0-131-126 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:34:17.285806 ip-10-0-131-126 kubenswrapper[2590]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:34:17.285806 ip-10-0-131-126 kubenswrapper[2590]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:34:17.285806 ip-10-0-131-126 kubenswrapper[2590]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:34:17.285806 ip-10-0-131-126 kubenswrapper[2590]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:34:17.285806 ip-10-0-131-126 kubenswrapper[2590]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:34:17.287884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.287788 2590 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:34:17.292439 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292417 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.292439 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292437 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.292439 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292441 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292445 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292449 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292452 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292454 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292457 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292460 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292462 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292470 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292473 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292475 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292478 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292481 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292483 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292486 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292488 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292491 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292493 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292496 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292498 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.292538 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292501 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292503 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292506 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292509 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292511 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292514 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292518 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292522 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292524 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292527 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292530 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292533 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292535 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292538 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292541 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292544 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292547 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292550 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292552 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.293016 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292555 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292557 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292562 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292565 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292568 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292571 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292574 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292577 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292580 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292583 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292586 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292588 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292591 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292594 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292596 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292599 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292602 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292605 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292608 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.293495 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292610 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292613 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292616 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292618 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292621 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292623 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292626 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292629 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292635 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292638 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292640 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292644 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292648 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292651 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292653 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292656 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292659 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292661 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292664 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.293940 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292666 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292669 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292672 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292674 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292676 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292679 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292682 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292684 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292687 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292689 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292691 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292694 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292696 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292716 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292721 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292724 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292727 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292730 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292733 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.292736 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.294399 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293478 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293486 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293489 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293492 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293494 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293497 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293500 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293503 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293506 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293508 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293513 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293516 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293519 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293521 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293524 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293526 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293529 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293531 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293534 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293537 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.294871 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293540 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293542 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293547 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293550 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293554 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293557 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293560 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293562 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293565 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293568 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293571 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293574 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293577 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293580 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293583 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293585 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293588 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293590 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293593 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293596 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.295414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293598 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293601 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293603 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293606 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293609 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293612 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293615 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293617 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293620 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293624 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293627 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293631 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293634 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293636 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293639 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293641 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293643 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293646 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293648 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293651 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.295901 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293653 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293657 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293661 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293664 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293668 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293671 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293674 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293677 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293679 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293682 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293685 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293687 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293689 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293692 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293694 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293697 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293700 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293702 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293706 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.296414 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293708 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293711 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293713 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293716 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293718 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293721 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293723 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293726 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293728 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293730 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293733 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293735 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293738 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293740 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293743 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293748 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293751 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293755 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293758 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.293760 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.296892 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294186 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294193 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294195 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294198 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294201 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294203 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294206 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294209 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294212 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294215 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294218 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294220 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294223 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294226 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294228 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294231 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294233 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294236 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294238 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294241 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.297382 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294243 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294246 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294248 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294251 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294253 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294256 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294259 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294262 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294264 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294268 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294270 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294273 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294277 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294279 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294282 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294284 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294287 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294289 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294292 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.297888 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294294 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294297 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294299 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294302 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294305 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294307 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294309 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294313 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294315 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294318 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294320 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294323 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294325 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294327 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294330 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294333 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294335 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294338 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294340 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.298360 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294342 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294345 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294348 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294351 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294354 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294356 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294359 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294361 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294364 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294366 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294369 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294371 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294374 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294378 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294381 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294384 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294388 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294392 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294394 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.298818 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294397 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294401 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294404 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294407 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294410 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294413 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294416 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294419 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294422 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294424 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294426 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294429 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294431 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294434 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294437 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294439 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294442 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294444 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294447 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294450 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.299303 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294452 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.294455 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294542 2590 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294564 2590 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294573 2590 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294578 2590 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294582 2590 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294585 2590 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294590 2590 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294594 2590 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294597 2590 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294601 2590 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294605 2590 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294609 2590 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294612 2590 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294615 2590 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294617 2590 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294620 2590 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294623 2590 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.294626 2590 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295228 2590 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295232 2590 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295236 2590 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295239 2590 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:34:17.299792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295243 2590 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295247 2590 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295250 2590 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295253 2590 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295257 2590 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295260 2590 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295263 2590 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295266 2590 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295269 2590 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295272 2590 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295276 2590 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295279 2590 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295282 2590 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295285 2590 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295288 2590 flags.go:64] FLAG: --enable-server="true" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295292 2590 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295297 2590 flags.go:64] FLAG: --event-burst="100" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295300 2590 flags.go:64] FLAG: --event-qps="50" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295305 2590 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295308 2590 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295312 2590 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295316 2590 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295318 2590 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295321 2590 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295324 2590 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:34:17.300410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295327 2590 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295330 2590 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295333 2590 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295339 2590 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295342 2590 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295345 2590 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295347 2590 flags.go:64] FLAG: --feature-gates="" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295351 2590 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295355 2590 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295361 2590 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295365 2590 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295368 2590 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295371 2590 flags.go:64] FLAG: --help="false" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295374 2590 flags.go:64] FLAG: --hostname-override="ip-10-0-131-126.ec2.internal" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295377 2590 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295380 2590 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295383 2590 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295388 2590 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295391 2590 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295394 2590 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295397 2590 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295399 2590 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295402 2590 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:34:17.301015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295405 2590 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295408 2590 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295411 2590 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295414 2590 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295417 2590 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295421 2590 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295424 2590 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295427 2590 flags.go:64] FLAG: --lock-file="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295430 2590 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295433 2590 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295437 2590 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295442 2590 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295448 2590 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295451 2590 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295453 2590 flags.go:64] FLAG: --logging-format="text" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295456 2590 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295460 2590 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295462 2590 flags.go:64] FLAG: --manifest-url="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295466 2590 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295471 2590 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295474 2590 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295478 2590 flags.go:64] FLAG: --max-pods="110" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295482 2590 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295485 2590 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295488 2590 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:34:17.301624 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295491 2590 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295493 2590 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295496 2590 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295499 2590 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295507 2590 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295510 2590 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295513 2590 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295516 2590 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295519 2590 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295525 2590 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295529 2590 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295532 2590 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295535 2590 flags.go:64] FLAG: --port="10250" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295539 2590 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295542 2590 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c0774577ad7fd4d" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295545 2590 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295548 2590 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295551 2590 flags.go:64] FLAG: --register-node="true" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295554 2590 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295560 2590 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295563 2590 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295565 2590 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295568 2590 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295572 2590 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295575 2590 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:34:17.302575 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295578 2590 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295583 2590 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295586 2590 flags.go:64] FLAG: --runonce="false" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295589 2590 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295592 2590 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295595 2590 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295598 2590 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295601 2590 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295604 2590 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295607 2590 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295610 2590 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295613 2590 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295616 2590 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295618 2590 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295621 2590 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295624 2590 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295627 2590 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295630 2590 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295635 2590 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295638 2590 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295641 2590 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295645 2590 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295648 2590 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295650 2590 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295653 2590 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:34:17.303263 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295656 2590 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295660 2590 flags.go:64] FLAG: --v="2" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295664 2590 flags.go:64] FLAG: --version="false" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295668 2590 flags.go:64] FLAG: --vmodule="" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295672 2590 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.295675 2590 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295806 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295810 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295814 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295817 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295819 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295822 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295825 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295828 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295830 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295833 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295835 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295838 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295841 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295843 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295846 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.304238 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295848 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295851 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295854 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295856 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295859 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295861 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295864 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295868 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295872 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295874 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295877 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295880 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295884 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295887 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295889 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295892 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295895 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295897 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295900 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.304821 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295904 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295907 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295909 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295913 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295915 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295918 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295922 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295925 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295929 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295931 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295934 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295936 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295940 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295943 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295946 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295949 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295952 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295955 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295958 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.305336 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295961 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295964 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295966 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295969 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295971 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295974 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295978 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295980 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295983 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295985 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295987 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295990 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295993 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295996 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.295999 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296002 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296005 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296007 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296010 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296012 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.305919 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296014 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296017 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296020 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296022 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296025 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296027 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296030 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296033 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296035 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296038 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296040 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296043 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296045 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296048 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296051 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296053 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296056 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296059 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296062 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296065 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.306445 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296067 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296070 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296073 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296075 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296078 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.296081 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.296642 2590 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.305269 2590 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.305287 2590 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.305309 2590 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.305314 2590 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305373 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305378 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305383 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.306943 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305387 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305391 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305394 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305397 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305400 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305403 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305406 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305409 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305412 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305415 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305418 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305421 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305424 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305426 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305429 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305431 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305434 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305436 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305439 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305442 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.307313 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305444 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305447 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305450 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305453 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305456 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305459 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305463 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305466 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305469 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305472 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305474 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305477 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305481 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305484 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305487 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305490 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305493 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305495 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305498 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.307796 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305500 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305503 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305506 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305508 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305511 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305513 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305516 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305518 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305521 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305524 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305526 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305529 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305531 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305534 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305537 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305539 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305542 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305545 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305548 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305552 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.308353 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305554 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305557 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305560 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305562 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305565 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305567 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305570 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305572 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305575 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305577 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305580 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305582 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305586 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305590 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305593 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305596 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305599 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305608 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305611 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305614 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.308890 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305617 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305620 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305623 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305626 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305628 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305631 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305634 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305637 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305640 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305642 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305645 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305649 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305652 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305654 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305657 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305660 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.309398 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305663 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.305668 2590 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305793 2590 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305799 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305803 2590 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305806 2590 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305809 2590 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305813 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305816 2590 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305818 2590 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305821 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305824 2590 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305827 2590 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305830 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:34:17.309823 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305833 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305836 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305839 2590 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305841 2590 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305844 2590 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305847 2590 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305849 2590 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305852 2590 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305855 2590 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305858 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305862 2590 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305865 2590 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305868 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305871 2590 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305875 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305878 2590 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305881 2590 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305884 2590 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305886 2590 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305889 2590 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:34:17.310273 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305892 2590 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305894 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305897 2590 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305900 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305902 2590 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305905 2590 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305908 2590 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305910 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305913 2590 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305915 2590 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305918 2590 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305920 2590 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305923 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305927 2590 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305929 2590 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305932 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305935 2590 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305938 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305940 2590 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305943 2590 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:34:17.310822 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305945 2590 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305947 2590 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305950 2590 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305953 2590 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305955 2590 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305958 2590 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305961 2590 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305964 2590 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305967 2590 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305969 2590 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305972 2590 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305974 2590 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305977 2590 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305980 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305982 2590 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305985 2590 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305987 2590 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305990 2590 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305992 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305995 2590 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:34:17.311651 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.305997 2590 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306000 2590 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306002 2590 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306005 2590 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306008 2590 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306012 2590 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306015 2590 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306019 2590 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306022 2590 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306025 2590 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306028 2590 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306031 2590 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306034 2590 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306036 2590 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306040 2590 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306042 2590 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306045 2590 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306048 2590 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306051 2590 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:34:17.312324 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306053 2590 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306056 2590 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306059 2590 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306061 2590 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306064 2590 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306067 2590 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306069 2590 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:17.306072 2590 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.306076 2590 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.306236 2590 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.308473 2590 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.309681 2590 server.go:1019] "Starting client certificate rotation" Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.309795 2590 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:34:17.312873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.309840 2590 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:34:17.313480 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.311960 2590 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:34:17.313480 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.313129 2590 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:34:17.322333 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.322311 2590 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:34:17.324417 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.324404 2590 log.go:25] "Validated CRI v1 image API" Jul 07 14:34:17.325163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.325148 2590 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:34:17.327369 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.327342 2590 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8dbad492-8c72-41dd-876a-1229a8197d05:/dev/nvme0n1p4 96af0095-37f0-4547-9dbf-a5a611636cfe:/dev/nvme0n1p3] Jul 07 14:34:17.327439 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.327368 2590 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:34:17.332730 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.332613 2590 manager.go:216] Machine: {Timestamp:2026-07-07 14:34:17.332072297 +0000 UTC m=+0.291725331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec215bfbd049879278182ca8753747db SystemUUID:ec215bfb-d049-8792-7818-2ca8753747db BootID:b2cf864a-6713-4703-a30a-4457e8271caf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:26:17:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:26:17:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:bd:cc:4b:c1:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:34:17.332730 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.332726 2590 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:34:17.332848 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.332813 2590 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:34:17.335346 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.335319 2590 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:34:17.335543 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.335349 2590 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:34:17.336053 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.336042 2590 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:34:17.336088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.336057 2590 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:34:17.336088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.336065 2590 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:34:17.336698 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.336687 2590 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:34:17.337970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.337959 2590 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:34:17.342041 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342028 2590 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:34:17.342195 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342185 2590 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:34:17.342848 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342839 2590 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:34:17.342876 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342864 2590 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:34:17.342911 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342879 2590 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:34:17.342911 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342890 2590 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:34:17.342911 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.342898 2590 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:34:17.343446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.343428 2590 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:34:17.343559 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.343456 2590 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:34:17.346304 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.346273 2590 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:34:17.348035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.348019 2590 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:34:17.348137 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.348049 2590 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:34:17.349042 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349029 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349045 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349051 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349057 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349067 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349072 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349081 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349086 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349093 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349111 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349119 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:34:17.349147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349124 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:34:17.349755 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349745 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:34:17.349755 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.349756 2590 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:34:17.353182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.353160 2590 server.go:1268] "Started kubelet" Jul 07 14:34:17.353300 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.353248 2590 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:34:17.353810 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.353742 2590 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:34:17.353897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.353826 2590 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:34:17.354301 ip-10-0-131-126 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:34:17.354897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.354878 2590 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:34:17.354961 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.354909 2590 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:34:17.354961 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.354915 2590 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:34:17.355259 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.355240 2590 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:34:17.355342 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.355295 2590 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:34:17.359198 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.358350 2590 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc0952c77 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.353129079 +0000 UTC m=+0.312782119,LastTimestamp:2026-07-07 14:34:17.353129079 +0000 UTC m=+0.312782119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.359709 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.359684 2590 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:34:17.360725 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.360710 2590 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:34:17.360799 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.360744 2590 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:34:17.360849 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.360811 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:17.361431 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361414 2590 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:34:17.361521 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361453 2590 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:34:17.361521 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361476 2590 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:34:17.361621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361591 2590 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:34:17.361621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361602 2590 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:34:17.361621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361603 2590 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:34:17.361621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361619 2590 factory.go:55] Registering systemd factory Jul 07 14:34:17.361857 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361628 2590 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:34:17.361857 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361852 2590 factory.go:153] Registering CRI-O factory Jul 07 14:34:17.361952 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361871 2590 factory.go:223] Registration of the crio container factory successfully Jul 07 14:34:17.361952 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361893 2590 factory.go:103] Registering Raw factory Jul 07 14:34:17.361952 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.361906 2590 manager.go:1196] Started watching for new ooms in manager Jul 07 14:34:17.362536 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.362521 2590 manager.go:349] Starting recovery of all containers Jul 07 14:34:17.370244 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.370202 2590 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:34:17.370330 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.370195 2590 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:34:17.375267 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.374992 2590 manager.go:354] Recovery completed Jul 07 14:34:17.376660 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.376635 2590 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 14:34:17.379734 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.379722 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:17.381712 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.381695 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:17.381768 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.381728 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:17.381768 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.381741 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:17.382285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.382270 2590 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:34:17.382285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.382283 2590 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:34:17.382395 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.382297 2590 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:34:17.382395 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.382283 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:17.383095 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.383078 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:17.383200 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.383147 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:17.383200 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.383163 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:17.383667 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.383571 2590 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc2494cc9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.381711049 +0000 UTC m=+0.341364083,LastTimestamp:2026-07-07 14:34:17.381711049 +0000 UTC m=+0.341364083,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.384452 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.384441 2590 policy_none.go:49] "None policy: Start" Jul 07 14:34:17.384504 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.384456 2590 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:34:17.384504 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.384466 2590 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:34:17.386558 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.386543 2590 policy_none.go:47] "Start" Jul 07 14:34:17.395346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.395274 2590 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc249a842 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.381734466 +0000 UTC m=+0.341387502,LastTimestamp:2026-07-07 14:34:17.381734466 +0000 UTC m=+0.341387502,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.397000 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.396984 2590 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:34:17.405916 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.405839 2590 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc249d0e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-126.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.381744867 +0000 UTC m=+0.341397902,LastTimestamp:2026-07-07 14:34:17.381744867 +0000 UTC m=+0.341397902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.415319 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.415244 2590 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-126.ec2.internal.18c0088dc2494cc9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc2494cc9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.381711049 +0000 UTC m=+0.341364083,LastTimestamp:2026-07-07 14:34:17.383092693 +0000 UTC m=+0.342745726,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.421669 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.421652 2590 manager.go:337] "Starting Device Plugin manager" Jul 07 14:34:17.421724 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.421699 2590 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:34:17.421724 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.421712 2590 server.go:87] "Starting device plugin registration server" Jul 07 14:34:17.421967 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.421952 2590 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:34:17.422064 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.421966 2590 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:34:17.422129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.422059 2590 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:34:17.422169 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.422160 2590 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:34:17.422169 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.422169 2590 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:34:17.422384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.422366 2590 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hwjgp" Jul 07 14:34:17.422769 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.422742 2590 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:34:17.422856 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.422794 2590 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:17.425477 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:17.425398 2590 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-126.ec2.internal.18c0088dc249a842\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-126.ec2.internal.18c0088dc249a842 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-126.ec2.internal,UID:ip-10-0-131-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-126.ec2.internal,},FirstTimestamp:2026-07-07 14:34:17.381734466 +0000 UTC m=+0.341387502,LastTimestamp:2026-07-07 14:34:17.383155709 +0000 UTC m=+0.342808745,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-126.ec2.internal,}" Jul 07 14:34:17.430906 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:17.430888 2590 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hwjgp" Jul 07 14:34:18.657925 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.657882 2590 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:34:18.659132 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.659105 2590 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:34:18.659183 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.659161 2590 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:34:18.659223 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.659188 2590 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:34:18.659273 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.659233 2590 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:34:18.661572 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.661543 2590 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:18.686380 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.686350 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:18.687529 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.687510 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:18.687612 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.687542 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:18.687612 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.687553 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:18.687612 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.687577 2590 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.696785 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.696760 2590 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.696833 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.696788 2590 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-126.ec2.internal\": node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:18.717383 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.717295 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:18.760165 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.760114 2590 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal"] Jul 07 14:34:18.760343 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.760213 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:18.761814 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.761796 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:18.761902 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.761828 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:18.761902 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.761838 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:18.764241 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764229 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:18.764344 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764330 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.764379 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764358 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:18.764975 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764960 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:18.765045 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764985 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:18.765045 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.764995 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:18.765396 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.765378 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:18.765488 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.765412 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:18.765488 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.765429 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:18.767683 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.767670 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.767751 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.767694 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:18.768294 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.768277 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:18.768388 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.768303 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:18.768388 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.768316 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:18.796686 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.796657 2590 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-126.ec2.internal\" not found" node="ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.802676 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.802636 2590 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-126.ec2.internal\" not found" node="ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.817424 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.817403 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:18.827128 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.827102 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.827253 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.827133 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.827253 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.827158 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9496e6239949feac3069ae863246fd9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-126.ec2.internal\" (UID: \"a9496e6239949feac3069ae863246fd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.917729 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:18.917693 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:18.928160 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928134 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.928269 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928171 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.928269 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928196 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9496e6239949feac3069ae863246fd9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-126.ec2.internal\" (UID: \"a9496e6239949feac3069ae863246fd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.928269 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928237 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.928376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928240 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9496e6239949feac3069ae863246fd9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-126.ec2.internal\" (UID: \"a9496e6239949feac3069ae863246fd9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:18.928376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:18.928243 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74d2401f41dfe9ac83ad0bbfb5d0771e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal\" (UID: \"74d2401f41dfe9ac83ad0bbfb5d0771e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:19.018601 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.018520 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.100127 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.100085 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:19.106401 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.106371 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:19.119085 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.119063 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.219596 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.219553 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.320248 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.320162 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.398740 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.398708 2590 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:19.420519 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.420483 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.473138 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.473093 2590 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:34:19.473745 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.473261 2590 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:34:19.473745 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.473296 2590 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:34:19.521299 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.521271 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.535391 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.535369 2590 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:19.597945 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.597848 2590 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:29:18 +0000 UTC" deadline="2028-03-07 06:33:45.428291861 +0000 UTC" Jul 07 14:34:19.597945 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.597900 2590 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14607h59m25.830395536s" Jul 07 14:34:19.622022 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.621993 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.722600 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.722566 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.734993 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:19.734958 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9496e6239949feac3069ae863246fd9.slice/crio-c90d24ad0fb647694167cc11d00d3aafc08e58018cf77825d6adebeef11375cc WatchSource:0}: Error finding container c90d24ad0fb647694167cc11d00d3aafc08e58018cf77825d6adebeef11375cc: Status 404 returned error can't find the container with id c90d24ad0fb647694167cc11d00d3aafc08e58018cf77825d6adebeef11375cc Jul 07 14:34:19.735234 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:19.735214 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d2401f41dfe9ac83ad0bbfb5d0771e.slice/crio-6059988c28bed33b623f93689278f0a4c0dad1e588160e8db1205f4b3bcf3bc6 WatchSource:0}: Error finding container 6059988c28bed33b623f93689278f0a4c0dad1e588160e8db1205f4b3bcf3bc6: Status 404 returned error can't find the container with id 6059988c28bed33b623f93689278f0a4c0dad1e588160e8db1205f4b3bcf3bc6 Jul 07 14:34:19.739851 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.739836 2590 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:34:19.757086 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.757064 2590 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:34:19.757975 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.757958 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:34:19.758043 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.757986 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:34:19.758043 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.757997 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:34:19.823034 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:19.823005 2590 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-126.ec2.internal\" not found" Jul 07 14:34:19.917709 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.917684 2590 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:19.924523 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.924501 2590 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" Jul 07 14:34:19.937661 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.937631 2590 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:34:19.938453 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.938441 2590 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" Jul 07 14:34:19.947227 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:19.947212 2590 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:34:20.339313 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.339238 2590 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:20.508932 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.508900 2590 apiserver.go:52] "Watching apiserver" Jul 07 14:34:20.515857 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.515833 2590 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:34:20.517360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.517327 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-cbmr8","openshift-network-operator/iptables-alerter-nztz2","openshift-ovn-kubernetes/ovnkube-node-tqvd7","kube-system/konnectivity-agent-zs8m6","kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m4c4n","openshift-image-registry/node-ca-rw669","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal","openshift-multus/multus-additional-cni-plugins-8svzx","openshift-multus/multus-mgd5f","openshift-network-diagnostics/network-check-target-6ms86","kube-system/global-pull-secret-syncer-lbjrz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p","openshift-dns/node-resolver-wdmlz"] Jul 07 14:34:20.519979 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.519956 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.522190 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.522163 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.522340 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.522290 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:20.522794 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.522761 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:34:20.522794 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.522783 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrghk\"" Jul 07 14:34:20.522794 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.522763 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.523058 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.522761 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.524809 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.524788 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.526898 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.526240 2590 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:34:20.527599 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.527575 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.527963 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.527578 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.528148 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.528124 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.528872 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.528954 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9kqrk\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.529132 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.529217 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.529432 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.529700 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:34:20.530130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.529977 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:34:20.530520 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.530322 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5k5g\"" Jul 07 14:34:20.530520 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.530451 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.530611 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.530524 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:20.532682 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.532399 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.535841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535325 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.535841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535447 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.535980 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535902 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.535980 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535911 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2sk6v\"" Jul 07 14:34:20.535980 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535934 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.535980 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535963 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-node-log\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.535987 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-bin\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536012 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/023a760b-274f-4be4-8133-bdae9e319beb-agent-certs\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536037 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/023a760b-274f-4be4-8133-bdae9e319beb-konnectivity-ca\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536063 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjpmj\" (UniqueName: \"kubernetes.io/projected/f96e10b4-3b06-485c-9421-f49f2a06167f-kube-api-access-kjpmj\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536085 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-systemd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536143 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-systemd-units\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536089 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536169 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-etc-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536242 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-host\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536281 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-serviceca\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536307 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-config\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536331 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-env-overrides\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536359 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-log-socket\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536382 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536408 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-dbus\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.536448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536444 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-kubelet\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536469 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-slash\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536492 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-var-lib-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536531 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-ovn\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536561 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96e10b4-3b06-485c-9421-f49f2a06167f-ovn-node-metrics-cert\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536584 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-script-lib\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536618 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rttxs\" (UniqueName: \"kubernetes.io/projected/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-kube-api-access-rttxs\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536655 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-netns\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536684 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-netd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536718 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.536918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.536743 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-kubelet-config\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.537438 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.537419 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.538884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.537712 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:34:20.538884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.537812 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:34:20.538884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.538066 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f62zn\"" Jul 07 14:34:20.538884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.538379 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.538884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.538756 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.539204 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.538957 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:34:20.539306 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.539283 2590 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:34:20.539853 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.539612 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q68z7\"" Jul 07 14:34:20.539853 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.539621 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.539853 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.539760 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.540043 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.540026 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.542039 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.542017 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.542333 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.542313 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:34:20.542552 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.542532 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rxtbv\"" Jul 07 14:34:20.542795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.542779 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.543008 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.542981 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.544925 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.544822 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:20.544925 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.544885 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:20.546018 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.545859 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:34:20.546018 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.545887 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clmnv\"" Jul 07 14:34:20.547362 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.547098 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.549184 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.549162 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sltn4\"" Jul 07 14:34:20.549516 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.549494 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:34:20.549605 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.549570 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:34:20.549813 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.549798 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:34:20.559026 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.559004 2590 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gb49v" Jul 07 14:34:20.567829 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.567808 2590 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gb49v" Jul 07 14:34:20.626767 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.626741 2590 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:34:20.637217 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637177 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637232 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-bin\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637260 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/023a760b-274f-4be4-8133-bdae9e319beb-agent-certs\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637259 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637291 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637317 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-system-cni-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637327 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-bin\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637343 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-k8s-cni-cncf-io\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637474 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjpmj\" (UniqueName: \"kubernetes.io/projected/f96e10b4-3b06-485c-9421-f49f2a06167f-kube-api-access-kjpmj\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637513 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637539 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-os-release\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637568 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637595 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk4wt\" (UniqueName: \"kubernetes.io/projected/4dc76eb3-2ae2-4d44-bb57-55964b190580-kube-api-access-jk4wt\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637622 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-systemd-units\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637663 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-etc-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637697 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-iptables-alerter-script\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637721 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-device-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637745 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637762 2590 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:34:20.637806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637775 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637811 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-host\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637843 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg92f\" (UniqueName: \"kubernetes.io/projected/908f7ea3-b315-4a93-a41c-c60d7706443e-kube-api-access-hg92f\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637857 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-systemd-units\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637870 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-etc-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637907 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-os-release\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637951 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-host\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637971 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-hostroot\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.637994 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-env-overrides\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638016 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-conf\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638036 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-sys\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638059 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638080 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxln4\" (UniqueName: \"kubernetes.io/projected/a58518c8-09e0-4504-9e30-acac5a54d8f4-kube-api-access-vxln4\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638121 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-socket-dir-parent\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638142 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-multus\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638163 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-kubernetes\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638196 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908f7ea3-b315-4a93-a41c-c60d7706443e-hosts-file\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.638424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638259 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-host-slash\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638285 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cnibin\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638311 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-multus-certs\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638347 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-etc-kubernetes\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638385 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7ea3-b315-4a93-a41c-c60d7706443e-tmp-dir\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638422 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-socket-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638450 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-dbus\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638473 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysconfig\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638496 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638530 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-kubelet\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638532 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-env-overrides\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638555 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-script-lib\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638579 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-netd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638605 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-var-lib-kubelet\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638617 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-cni-netd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638630 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-lib-modules\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638671 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjcvt\" (UniqueName: \"kubernetes.io/projected/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-kube-api-access-bjcvt\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.639280 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638696 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-kubelet-config\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638723 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638695 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-dbus\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638747 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-node-log\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638760 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78a88ab8-8271-4896-8c6b-3a7492211865-kubelet-config\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638773 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/023a760b-274f-4be4-8133-bdae9e319beb-konnectivity-ca\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638808 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cnibin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638826 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-conf-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.638840 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638845 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74wf\" (UniqueName: \"kubernetes.io/projected/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-kube-api-access-g74wf\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638870 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cni-binary-copy\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638885 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.638918 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:21.138896743 +0000 UTC m=+2.935003884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638939 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-systemd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638968 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-host\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638991 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-tmp\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639014 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-sys-fs\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.640129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639036 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-system-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639059 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzsjw\" (UniqueName: \"kubernetes.io/projected/938c6c98-a2ca-477c-b313-a77ada5bc7d2-kube-api-access-bzsjw\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639089 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-serviceca\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639111 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-run\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639111 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-script-lib\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639124 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-systemd\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639133 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-tuned\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.638943 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-node-log\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639157 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzsp7\" (UniqueName: \"kubernetes.io/projected/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-kube-api-access-vzsp7\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639182 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-config\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639206 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-log-socket\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639244 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639268 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-modprobe-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639307 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639332 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-bin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639354 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-log-socket\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639357 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.640936 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639307 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/023a760b-274f-4be4-8133-bdae9e319beb-konnectivity-ca\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639423 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639448 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-registration-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639478 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-kubelet\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639503 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-slash\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639519 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-serviceca\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639529 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-var-lib-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639555 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-ovn\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639562 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-kubelet\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639570 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-slash\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639581 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-systemd\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639600 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-var-lib-openvswitch\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639606 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-netns\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639619 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-run-ovn\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639630 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-daemon-config\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639670 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96e10b4-3b06-485c-9421-f49f2a06167f-ovn-node-metrics-cert\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639693 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rttxs\" (UniqueName: \"kubernetes.io/projected/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-kube-api-access-rttxs\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.641788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639709 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-netns\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.642565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639710 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f96e10b4-3b06-485c-9421-f49f2a06167f-ovnkube-config\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.642565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639754 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.642565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639781 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-run-netns\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.642565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.639858 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96e10b4-3b06-485c-9421-f49f2a06167f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.643937 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.643906 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96e10b4-3b06-485c-9421-f49f2a06167f-ovn-node-metrics-cert\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.644293 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.644257 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/023a760b-274f-4be4-8133-bdae9e319beb-agent-certs\") pod \"konnectivity-agent-zs8m6\" (UID: \"023a760b-274f-4be4-8133-bdae9e319beb\") " pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.648071 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.648008 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjpmj\" (UniqueName: \"kubernetes.io/projected/f96e10b4-3b06-485c-9421-f49f2a06167f-kube-api-access-kjpmj\") pod \"ovnkube-node-tqvd7\" (UID: \"f96e10b4-3b06-485c-9421-f49f2a06167f\") " pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.653450 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.653423 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rttxs\" (UniqueName: \"kubernetes.io/projected/673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee-kube-api-access-rttxs\") pod \"node-ca-rw669\" (UID: \"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee\") " pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.666533 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.666219 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" event={"ID":"74d2401f41dfe9ac83ad0bbfb5d0771e","Type":"ContainerStarted","Data":"6059988c28bed33b623f93689278f0a4c0dad1e588160e8db1205f4b3bcf3bc6"} Jul 07 14:34:20.667433 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.667336 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" event={"ID":"a9496e6239949feac3069ae863246fd9","Type":"ContainerStarted","Data":"c90d24ad0fb647694167cc11d00d3aafc08e58018cf77825d6adebeef11375cc"} Jul 07 14:34:20.740860 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740829 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-systemd\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740868 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-netns\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740891 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-daemon-config\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740916 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740938 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-system-cni-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740948 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-netns\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740962 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-k8s-cni-cncf-io\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.740997 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741019 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-os-release\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741027 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-systemd\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741039 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741076 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk4wt\" (UniqueName: \"kubernetes.io/projected/4dc76eb3-2ae2-4d44-bb57-55964b190580-kube-api-access-jk4wt\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741102 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-iptables-alerter-script\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741125 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-device-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741150 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741153 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741172 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741212 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741225 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg92f\" (UniqueName: \"kubernetes.io/projected/908f7ea3-b315-4a93-a41c-c60d7706443e-kube-api-access-hg92f\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741243 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741249 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-os-release\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741272 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-hostroot\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741286 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-os-release\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741027 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-system-cni-dir\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741296 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-conf\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741320 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-sys\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741342 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.741535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741364 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxln4\" (UniqueName: \"kubernetes.io/projected/a58518c8-09e0-4504-9e30-acac5a54d8f4-kube-api-access-vxln4\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741393 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-socket-dir-parent\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741414 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-multus\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741436 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-kubernetes\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741458 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908f7ea3-b315-4a93-a41c-c60d7706443e-hosts-file\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741501 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-host-slash\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741519 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-daemon-config\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741526 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cnibin\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741556 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cnibin\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741570 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-multus-certs\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741595 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-etc-kubernetes\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741614 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741618 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7ea3-b315-4a93-a41c-c60d7706443e-tmp-dir\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741667 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-socket-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741695 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysconfig\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741721 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741748 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-kubelet\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.742310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741776 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-var-lib-kubelet\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741818 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-lib-modules\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741841 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-socket-dir-parent\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741848 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcvt\" (UniqueName: \"kubernetes.io/projected/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-kube-api-access-bjcvt\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741870 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741883 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908f7ea3-b315-4a93-a41c-c60d7706443e-tmp-dir\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741290 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-k8s-cni-cncf-io\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741906 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cnibin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741954 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-run-multus-certs\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741963 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cnibin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741977 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-conf-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742011 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/908f7ea3-b315-4a93-a41c-c60d7706443e-hosts-file\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742016 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-kubernetes\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742005 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74wf\" (UniqueName: \"kubernetes.io/projected/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-kube-api-access-g74wf\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742016 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-etc-kubernetes\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742493 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-host-slash\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742510 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysconfig\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.741972 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-device-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.743097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742561 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-socket-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742566 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-multus-conf-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742576 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-os-release\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742639 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-var-lib-kubelet\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742643 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-iptables-alerter-script\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742731 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-lib-modules\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742747 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-hostroot\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742513 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-multus\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742950 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cni-binary-copy\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742983 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.742990 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743053 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-sys\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743119 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-host\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743158 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-tmp\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743176 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-sysctl-conf\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743196 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-sys-fs\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743264 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-sys-fs\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743315 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-kubelet\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.743957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743367 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743369 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-host\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743423 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-system-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743455 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-system-cni-dir\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743465 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzsjw\" (UniqueName: \"kubernetes.io/projected/938c6c98-a2ca-477c-b313-a77ada5bc7d2-kube-api-access-bzsjw\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743482 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/938c6c98-a2ca-477c-b313-a77ada5bc7d2-cni-binary-copy\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743493 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-run\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743533 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-tuned\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743545 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-run\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743586 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzsp7\" (UniqueName: \"kubernetes.io/projected/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-kube-api-access-vzsp7\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743616 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-modprobe-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743664 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743697 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-bin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743727 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743756 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-registration-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.743951 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/938c6c98-a2ca-477c-b313-a77ada5bc7d2-host-var-lib-cni-bin\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.744004 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:20.744758 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.744068 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:21.244050577 +0000 UTC m=+3.040157718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:20.745505 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.744065 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-modprobe-d\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.745505 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.744237 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.745505 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.744311 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a58518c8-09e0-4504-9e30-acac5a54d8f4-registration-dir\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.746533 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.746508 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-etc-tuned\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.746641 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.746545 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-tmp\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.748803 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.748782 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:20.748921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.748806 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:20.748921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.748820 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:20.748921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:20.748876 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:21.248859901 +0000 UTC m=+3.044967047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:20.751337 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.751312 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjcvt\" (UniqueName: \"kubernetes.io/projected/ace4c438-a1e2-42dc-81ad-3ad7faa1963d-kube-api-access-bjcvt\") pod \"iptables-alerter-nztz2\" (UID: \"ace4c438-a1e2-42dc-81ad-3ad7faa1963d\") " pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.751788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.751734 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg92f\" (UniqueName: \"kubernetes.io/projected/908f7ea3-b315-4a93-a41c-c60d7706443e-kube-api-access-hg92f\") pod \"node-resolver-wdmlz\" (UID: \"908f7ea3-b315-4a93-a41c-c60d7706443e\") " pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.752209 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.752185 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk4wt\" (UniqueName: \"kubernetes.io/projected/4dc76eb3-2ae2-4d44-bb57-55964b190580-kube-api-access-jk4wt\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:20.752744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.752721 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzsjw\" (UniqueName: \"kubernetes.io/projected/938c6c98-a2ca-477c-b313-a77ada5bc7d2-kube-api-access-bzsjw\") pod \"multus-mgd5f\" (UID: \"938c6c98-a2ca-477c-b313-a77ada5bc7d2\") " pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.753804 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.753777 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74wf\" (UniqueName: \"kubernetes.io/projected/aceb0b20-1ac5-42a6-8fb2-9e478d9325e5-kube-api-access-g74wf\") pod \"multus-additional-cni-plugins-8svzx\" (UID: \"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5\") " pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.753900 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.753845 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzsp7\" (UniqueName: \"kubernetes.io/projected/8faf5536-f3e4-4e53-afa0-8c5345cbf8e0-kube-api-access-vzsp7\") pod \"tuned-m4c4n\" (UID: \"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.753942 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.753918 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxln4\" (UniqueName: \"kubernetes.io/projected/a58518c8-09e0-4504-9e30-acac5a54d8f4-kube-api-access-vxln4\") pod \"aws-ebs-csi-driver-node-l8d9p\" (UID: \"a58518c8-09e0-4504-9e30-acac5a54d8f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:20.836802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.836767 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rw669" Jul 07 14:34:20.847940 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.847872 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:20.860545 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.860524 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:20.867292 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.867268 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" Jul 07 14:34:20.880115 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.880082 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8svzx" Jul 07 14:34:20.889005 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.888983 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdmlz" Jul 07 14:34:20.898591 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.898571 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nztz2" Jul 07 14:34:20.909225 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.909197 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mgd5f" Jul 07 14:34:20.916028 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:20.916006 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" Jul 07 14:34:21.146522 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.146495 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:21.146696 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.146664 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:21.146772 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.146741 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:22.146719704 +0000 UTC m=+3.942826847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:21.161543 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.161513 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58518c8_09e0_4504_9e30_acac5a54d8f4.slice/crio-4d0c978cd29b0ff0638222e00981919112d714b7d099c1f4e0146221f2dd1013 WatchSource:0}: Error finding container 4d0c978cd29b0ff0638222e00981919112d714b7d099c1f4e0146221f2dd1013: Status 404 returned error can't find the container with id 4d0c978cd29b0ff0638222e00981919112d714b7d099c1f4e0146221f2dd1013 Jul 07 14:34:21.162850 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.162703 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceb0b20_1ac5_42a6_8fb2_9e478d9325e5.slice/crio-43e135b87373d3080c73e0dd188b4773a882b7847aabb0974363b348dd325e0f WatchSource:0}: Error finding container 43e135b87373d3080c73e0dd188b4773a882b7847aabb0974363b348dd325e0f: Status 404 returned error can't find the container with id 43e135b87373d3080c73e0dd188b4773a882b7847aabb0974363b348dd325e0f Jul 07 14:34:21.169711 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.169686 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96e10b4_3b06_485c_9421_f49f2a06167f.slice/crio-5480c5b9481c34d2a70332e718680eb9d6d4914730605c77a58ddbb8d21bd633 WatchSource:0}: Error finding container 5480c5b9481c34d2a70332e718680eb9d6d4914730605c77a58ddbb8d21bd633: Status 404 returned error can't find the container with id 5480c5b9481c34d2a70332e718680eb9d6d4914730605c77a58ddbb8d21bd633 Jul 07 14:34:21.191250 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.191216 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908f7ea3_b315_4a93_a41c_c60d7706443e.slice/crio-e12ef24c07829446d30a25671291c153828e0a9394c336a285adcc8158afcd4b WatchSource:0}: Error finding container e12ef24c07829446d30a25671291c153828e0a9394c336a285adcc8158afcd4b: Status 404 returned error can't find the container with id e12ef24c07829446d30a25671291c153828e0a9394c336a285adcc8158afcd4b Jul 07 14:34:21.191842 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.191773 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023a760b_274f_4be4_8133_bdae9e319beb.slice/crio-60c6c9918abd89bd738b642fa21d27cec1a8021c69bae658ec1c01ffbc283d1d WatchSource:0}: Error finding container 60c6c9918abd89bd738b642fa21d27cec1a8021c69bae658ec1c01ffbc283d1d: Status 404 returned error can't find the container with id 60c6c9918abd89bd738b642fa21d27cec1a8021c69bae658ec1c01ffbc283d1d Jul 07 14:34:21.192862 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.192794 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8faf5536_f3e4_4e53_afa0_8c5345cbf8e0.slice/crio-518332c1210245b101ecfbe9baf1045cde6a26911a866a47a62579efabee52b0 WatchSource:0}: Error finding container 518332c1210245b101ecfbe9baf1045cde6a26911a866a47a62579efabee52b0: Status 404 returned error can't find the container with id 518332c1210245b101ecfbe9baf1045cde6a26911a866a47a62579efabee52b0 Jul 07 14:34:21.193788 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:21.193770 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace4c438_a1e2_42dc_81ad_3ad7faa1963d.slice/crio-41d8d977bd139003f76cd8d28549d0ef925598bb62bf4f336b7442be591bd640 WatchSource:0}: Error finding container 41d8d977bd139003f76cd8d28549d0ef925598bb62bf4f336b7442be591bd640: Status 404 returned error can't find the container with id 41d8d977bd139003f76cd8d28549d0ef925598bb62bf4f336b7442be591bd640 Jul 07 14:34:21.246847 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.246811 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:21.247025 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.246950 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:21.247085 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.247030 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:22.246997861 +0000 UTC m=+4.043104999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:21.347995 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.347955 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:21.348190 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.348150 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:21.348190 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.348174 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:21.348190 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.348186 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:21.348327 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.348243 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:22.348228648 +0000 UTC m=+4.144335776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:21.571578 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.571452 2590 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:29:20 +0000 UTC" deadline="2028-04-06 16:49:04.24519001 +0000 UTC" Jul 07 14:34:21.571578 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.571519 2590 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15338h14m42.67367559s" Jul 07 14:34:21.660256 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.660223 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:21.660400 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:21.660341 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:21.670719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.670679 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"5480c5b9481c34d2a70332e718680eb9d6d4914730605c77a58ddbb8d21bd633"} Jul 07 14:34:21.671886 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.671859 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nztz2" event={"ID":"ace4c438-a1e2-42dc-81ad-3ad7faa1963d","Type":"ContainerStarted","Data":"41d8d977bd139003f76cd8d28549d0ef925598bb62bf4f336b7442be591bd640"} Jul 07 14:34:21.672905 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.672879 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs8m6" event={"ID":"023a760b-274f-4be4-8133-bdae9e319beb","Type":"ContainerStarted","Data":"60c6c9918abd89bd738b642fa21d27cec1a8021c69bae658ec1c01ffbc283d1d"} Jul 07 14:34:21.674075 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.674046 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" event={"ID":"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0","Type":"ContainerStarted","Data":"518332c1210245b101ecfbe9baf1045cde6a26911a866a47a62579efabee52b0"} Jul 07 14:34:21.675055 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.675035 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rw669" event={"ID":"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee","Type":"ContainerStarted","Data":"66d10e154b0da8bebdd0267e26e6fa8539da34c94b3a3ead909386547228cbdb"} Jul 07 14:34:21.676100 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.676079 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdmlz" event={"ID":"908f7ea3-b315-4a93-a41c-c60d7706443e","Type":"ContainerStarted","Data":"e12ef24c07829446d30a25671291c153828e0a9394c336a285adcc8158afcd4b"} Jul 07 14:34:21.677203 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.677181 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgd5f" event={"ID":"938c6c98-a2ca-477c-b313-a77ada5bc7d2","Type":"ContainerStarted","Data":"b6bf580a6397c75c191ca24bfac86c86d773215157657d07d8d5de113d64c77f"} Jul 07 14:34:21.678265 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.678245 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerStarted","Data":"43e135b87373d3080c73e0dd188b4773a882b7847aabb0974363b348dd325e0f"} Jul 07 14:34:21.679288 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:21.679269 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" event={"ID":"a58518c8-09e0-4504-9e30-acac5a54d8f4","Type":"ContainerStarted","Data":"4d0c978cd29b0ff0638222e00981919112d714b7d099c1f4e0146221f2dd1013"} Jul 07 14:34:22.155798 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.155037 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:22.155798 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.155262 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:22.155798 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.155439 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:24.155406384 +0000 UTC m=+5.951513526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:22.256505 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.256460 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:22.256704 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.256625 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:22.256766 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.256717 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:24.256697901 +0000 UTC m=+6.052805034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:22.357808 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.357717 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:22.357983 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.357884 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:22.357983 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.357906 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:22.357983 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.357920 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:22.357983 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.357982 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:24.357962051 +0000 UTC m=+6.154069200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:22.564239 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.563979 2590 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:34:22.572316 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.572177 2590 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:29:20 +0000 UTC" deadline="2028-01-30 07:03:17.865511111 +0000 UTC" Jul 07 14:34:22.572316 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.572240 2590 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13720h28m55.293275913s" Jul 07 14:34:22.663382 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.662321 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:22.663382 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.662448 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:22.663382 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.662869 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:22.663382 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:22.663003 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:22.714937 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.714899 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" event={"ID":"a9496e6239949feac3069ae863246fd9","Type":"ContainerStarted","Data":"5bed02fc6a80969fb678365a32376b8d40bc8a05887e5bbf01a7c0a0c5e0d17a"} Jul 07 14:34:22.725572 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.725327 2590 generic.go:356] "Generic (PLEG): container finished" podID="74d2401f41dfe9ac83ad0bbfb5d0771e" containerID="5fb44e3817e8140879da5a31993f7d207f8d3e5c1fac991164495a98cb42ac96" exitCode=0 Jul 07 14:34:22.725572 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.725372 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" event={"ID":"74d2401f41dfe9ac83ad0bbfb5d0771e","Type":"ContainerDied","Data":"5fb44e3817e8140879da5a31993f7d207f8d3e5c1fac991164495a98cb42ac96"} Jul 07 14:34:22.749092 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:22.749034 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-126.ec2.internal" podStartSLOduration=3.749010412 podStartE2EDuration="3.749010412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:22.733090211 +0000 UTC m=+4.529197362" watchObservedRunningTime="2026-07-07 14:34:22.749010412 +0000 UTC m=+4.545117566" Jul 07 14:34:23.659833 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:23.659658 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:23.659833 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:23.659806 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:23.749541 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:23.749509 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" event={"ID":"74d2401f41dfe9ac83ad0bbfb5d0771e","Type":"ContainerStarted","Data":"15c965636481c1428c7c5d68328bc22cb18df19d7da2a0d104ac7b0703b2c649"} Jul 07 14:34:24.177512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:24.176951 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:24.177512 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.177092 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:24.177512 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.177156 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:28.17713739 +0000 UTC m=+9.973244524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:24.277752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:24.277714 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:24.277923 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.277870 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:24.277977 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.277930 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:28.277912331 +0000 UTC m=+10.074019458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:24.378438 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:24.378399 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:24.378622 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.378575 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:24.378622 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.378603 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:24.378622 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.378618 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:24.378793 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.378705 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:28.378684532 +0000 UTC m=+10.174791660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:24.660877 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:24.660841 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:24.661349 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.661011 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:24.661491 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:24.661470 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:24.661599 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:24.661577 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:25.660046 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:25.660012 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:25.660211 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:25.660154 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:26.659568 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:26.659473 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:26.660030 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:26.659603 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:26.660030 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:26.659829 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:26.660030 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:26.659971 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:27.659583 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:27.659545 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:27.660093 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:27.659734 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:28.210110 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:28.210059 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:28.210303 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.210235 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:28.210303 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.210298 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:36.210282797 +0000 UTC m=+18.006389930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:28.311297 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:28.311257 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:28.311466 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.311413 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:28.311543 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.311494 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:36.311473404 +0000 UTC m=+18.107580537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:28.412213 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:28.412122 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:28.412452 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.412326 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:28.412452 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.412352 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:28.412452 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.412367 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:28.412452 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.412449 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:36.412412625 +0000 UTC m=+18.208519776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:28.660552 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:28.660511 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:28.660552 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:28.660553 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:28.661093 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.660639 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:28.661093 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:28.660795 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:29.659453 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:29.659415 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:29.659666 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:29.659568 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:30.663349 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:30.663317 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:30.663908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:30.663363 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:30.663908 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:30.663465 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:30.663908 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:30.663595 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:31.659578 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:31.659540 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:31.659754 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:31.659704 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:32.659494 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:32.659457 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:32.659985 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:32.659613 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:32.659985 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:32.659669 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:32.659985 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:32.659811 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:33.659902 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:33.659862 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:33.660344 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:33.660005 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:34.659668 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:34.659622 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:34.659854 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:34.659622 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:34.659854 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:34.659791 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:34.659982 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:34.659850 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:35.659792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:35.659744 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:35.660009 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:35.659890 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:36.277031 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:36.276994 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:36.277194 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.277170 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:36.277274 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.277257 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:52.277234113 +0000 UTC m=+34.073341243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:36.378058 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:36.378022 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:36.378245 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.378154 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:36.378245 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.378224 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:52.37820468 +0000 UTC m=+34.174311808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:36.479205 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:36.479148 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:36.479362 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.479329 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:36.479362 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.479358 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:36.479456 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.479373 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:36.479456 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.479443 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:34:52.479422378 +0000 UTC m=+34.275529517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:36.659565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:36.659529 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:36.659772 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:36.659527 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:36.659772 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.659690 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:36.659772 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:36.659746 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:37.659971 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:37.659936 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:37.660461 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:37.660069 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:38.660169 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:38.660134 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:38.660625 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:38.660242 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:38.660625 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:38.660312 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:38.660625 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:38.660432 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:39.660104 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:39.660065 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:39.660308 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:39.660200 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:40.660192 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.659720 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:40.660192 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:40.660084 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:40.660973 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.659803 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:40.660973 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:40.660499 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:40.787475 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.787443 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="182aad695f10f882b97dba3b948129b25ca9062f46665771acdc027660f64d95" exitCode=0 Jul 07 14:34:40.787544 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.787519 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"182aad695f10f882b97dba3b948129b25ca9062f46665771acdc027660f64d95"} Jul 07 14:34:40.791635 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.791606 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" event={"ID":"a58518c8-09e0-4504-9e30-acac5a54d8f4","Type":"ContainerStarted","Data":"ebc4b4da858c30fe6d1eff663dc4510e6c8a078210c04badf56012c89f0ffadd"} Jul 07 14:34:40.795010 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.794978 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"f9795efc735fd5c718185cdbf83382231eda8a1162d6ba2ab2eaeb2a9ef1eee1"} Jul 07 14:34:40.795124 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.795064 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"f2a199cb840a3ea1f09e1d83d4c690fea4a425efc64941b95f87103e92577b74"} Jul 07 14:34:40.795124 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.795104 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"b4c2c96db8fd883bd7ac8cc9e1629d6e3db51ba95ee0bf19a1e5cce27dd05e19"} Jul 07 14:34:40.795213 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.795137 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"b274f09e417431531bdbbdec0bc7dee25e8b335989b14154d3de66fc687d7671"} Jul 07 14:34:40.796308 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.796280 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs8m6" event={"ID":"023a760b-274f-4be4-8133-bdae9e319beb","Type":"ContainerStarted","Data":"e15719d9b68ce9f0fa72c43f4732287beb804edb107b3f62edace93742d3a7a6"} Jul 07 14:34:40.797558 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.797538 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" event={"ID":"8faf5536-f3e4-4e53-afa0-8c5345cbf8e0","Type":"ContainerStarted","Data":"24627e28752e688ad88f04c56af45f6606f46f4e16b9017d7eb4657f85806193"} Jul 07 14:34:40.798789 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.798765 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rw669" event={"ID":"673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee","Type":"ContainerStarted","Data":"82175c550bbb681ce1553c1c263371185d0f8a15e8d319de9b81fdaca24b0a63"} Jul 07 14:34:40.799921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.799892 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdmlz" event={"ID":"908f7ea3-b315-4a93-a41c-c60d7706443e","Type":"ContainerStarted","Data":"95bbf8235b3132262f0947a923350c1ccd192bf7a6de1ec8e9ae3621d3f316b5"} Jul 07 14:34:40.801163 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.801143 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mgd5f" event={"ID":"938c6c98-a2ca-477c-b313-a77ada5bc7d2","Type":"ContainerStarted","Data":"e7143738b9a2127fda12d4abaddea1cf31b782c8f47c1a810af5ba3ef8ed5370"} Jul 07 14:34:40.808293 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.808258 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-126.ec2.internal" podStartSLOduration=21.808246938 podStartE2EDuration="21.808246938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:23.766720714 +0000 UTC m=+5.562827864" watchObservedRunningTime="2026-07-07 14:34:40.808246938 +0000 UTC m=+22.604354093" Jul 07 14:34:40.823538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.823501 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mgd5f" podStartSLOduration=3.596949312 podStartE2EDuration="22.823490485s" totalImagesPullingTime="19.226541173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:40.823292394 +0000 UTC m=+22.619399545" watchObservedRunningTime="2026-07-07 14:34:40.823490485 +0000 UTC m=+22.619597678" Jul 07 14:34:40.839224 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.839185 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4c4n" podStartSLOduration=11.631453377 podStartE2EDuration="22.839164741s" totalImagesPullingTime="11.207711364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:40.83898382 +0000 UTC m=+22.635090997" watchObservedRunningTime="2026-07-07 14:34:40.839164741 +0000 UTC m=+22.635271890" Jul 07 14:34:40.853780 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.853740 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wdmlz" podStartSLOduration=11.659146966 podStartE2EDuration="22.853725986s" totalImagesPullingTime="11.19457902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:40.853135261 +0000 UTC m=+22.649242428" watchObservedRunningTime="2026-07-07 14:34:40.853725986 +0000 UTC m=+22.649833137" Jul 07 14:34:40.872056 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.871970 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rw669" podStartSLOduration=11.648805314 podStartE2EDuration="22.871955231s" totalImagesPullingTime="11.223149917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:40.871887207 +0000 UTC m=+22.667994356" watchObservedRunningTime="2026-07-07 14:34:40.871955231 +0000 UTC m=+22.668062382" Jul 07 14:34:40.897153 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:40.897110 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zs8m6" podStartSLOduration=11.703910469 podStartE2EDuration="22.89709528s" totalImagesPullingTime="11.193184811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:40.895902526 +0000 UTC m=+22.692009678" watchObservedRunningTime="2026-07-07 14:34:40.89709528 +0000 UTC m=+22.693202461" Jul 07 14:34:41.660472 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:41.660434 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:41.661021 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:41.660614 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:41.807959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:41.807920 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"c465a9b9e5b633dc0dc9a3b496c5da80699ed279a273c281968d87adf418d937"} Jul 07 14:34:41.808123 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:41.808015 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"6c054f1bd4668993b73cefbe44dbebe7754cc46febcd01f490b5e630134afc3f"} Jul 07 14:34:41.809465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:41.809433 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nztz2" event={"ID":"ace4c438-a1e2-42dc-81ad-3ad7faa1963d","Type":"ContainerStarted","Data":"7a27a278f083832df7de73ebcfebc5ffcce82333c124333e30324fa5a089b263"} Jul 07 14:34:41.825225 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:41.825177 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nztz2" podStartSLOduration=12.631701506 podStartE2EDuration="23.825163595s" totalImagesPullingTime="11.193462089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:41.824733453 +0000 UTC m=+23.620840616" watchObservedRunningTime="2026-07-07 14:34:41.825163595 +0000 UTC m=+23.621270744" Jul 07 14:34:42.193587 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.193556 2590 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:34:42.599947 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.599811 2590 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:34:42.193580419Z","UUID":"08dae212-0799-4e81-bad3-4f56f8a01b89","Handler":null,"Name":"","Endpoint":""} Jul 07 14:34:42.601694 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.601673 2590 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:34:42.601836 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.601719 2590 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:34:42.659764 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.659728 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:42.659764 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.659757 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:42.659981 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:42.659861 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:42.660039 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:42.660008 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:42.814858 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:42.814810 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" event={"ID":"a58518c8-09e0-4504-9e30-acac5a54d8f4","Type":"ContainerStarted","Data":"6deb857841946028923bada38142e9da2f5a0c6b12005573a92bc4860c451b42"} Jul 07 14:34:43.175907 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:43.175857 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:43.176679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:43.176641 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:43.660343 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:43.660312 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:43.660507 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:43.660438 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:43.821799 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:43.821761 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"1d1d848fb2cabedbfb13009381a016a0f501967ba91dc495acbec70c10e3efab"} Jul 07 14:34:44.660685 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:44.660402 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:44.660885 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:44.660475 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:44.660885 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:44.660814 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:44.660885 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:44.660842 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:45.659511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.659346 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:45.660111 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:45.659591 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:45.829797 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.829675 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" event={"ID":"f96e10b4-3b06-485c-9421-f49f2a06167f","Type":"ContainerStarted","Data":"0e98cab56caf5d7b4557e7eca5c6aba48d193043f5a5cb333957c86e021ff279"} Jul 07 14:34:45.829962 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.829940 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:45.830028 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.830019 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:45.831519 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.831489 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="48bc9f1b0f4249ff9bb625a933d4d03b1c207edc6c8b2851e27d6b251896c37a" exitCode=0 Jul 07 14:34:45.831636 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.831559 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"48bc9f1b0f4249ff9bb625a933d4d03b1c207edc6c8b2851e27d6b251896c37a"} Jul 07 14:34:45.833866 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.833840 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" event={"ID":"a58518c8-09e0-4504-9e30-acac5a54d8f4","Type":"ContainerStarted","Data":"9a746b9d9d09e828320a9d986f67812be49de716e3399b2edeee96ac38859a80"} Jul 07 14:34:45.846525 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.846503 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:45.879901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.879848 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" podStartSLOduration=8.627750497 podStartE2EDuration="27.879830294s" totalImagesPullingTime="19.252079797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:45.863854034 +0000 UTC m=+27.659961184" watchObservedRunningTime="2026-07-07 14:34:45.879830294 +0000 UTC m=+27.675937440" Jul 07 14:34:45.880407 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:45.880386 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8d9p" podStartSLOduration=11.287293608 podStartE2EDuration="26.880376775s" totalImagesPullingTime="15.593083167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:45.8796812 +0000 UTC m=+27.675788347" watchObservedRunningTime="2026-07-07 14:34:45.880376775 +0000 UTC m=+27.676483925" Jul 07 14:34:46.075996 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.075958 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:46.076160 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.076111 2590 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 14:34:46.076732 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.076708 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zs8m6" Jul 07 14:34:46.660389 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.660354 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:46.660785 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.660395 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:46.660785 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:46.660506 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:46.660785 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:46.660617 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:46.837129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.837054 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:46.851588 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:46.851559 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:34:47.660284 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.660250 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:47.660468 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:47.660386 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:47.713894 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.713865 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lbjrz"] Jul 07 14:34:47.714429 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.714408 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ms86"] Jul 07 14:34:47.714513 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.714502 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:47.714607 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:47.714590 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:47.717538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.717515 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbmr8"] Jul 07 14:34:47.717683 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.717610 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:47.717760 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:47.717738 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:47.840642 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.840609 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="0b9d947a2819f2466bcd4c187fd7b597a00a8f02753905b73772c99fbd4abbbe" exitCode=0 Jul 07 14:34:47.840795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.840685 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"0b9d947a2819f2466bcd4c187fd7b597a00a8f02753905b73772c99fbd4abbbe"} Jul 07 14:34:47.841138 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:47.841122 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:47.841231 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:47.841211 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:48.845170 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:48.844931 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerStarted","Data":"92db5a6ef388fb8384493af5f7876a76a01c524ff16ae01c3a549babb44d7aff"} Jul 07 14:34:49.659747 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:49.659716 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:49.659914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:49.659751 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:49.659914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:49.659721 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:49.659914 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:49.659830 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:49.659914 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:49.659897 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:49.660089 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:49.659979 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:49.849674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:49.849571 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="92db5a6ef388fb8384493af5f7876a76a01c524ff16ae01c3a549babb44d7aff" exitCode=0 Jul 07 14:34:49.849674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:49.849608 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"92db5a6ef388fb8384493af5f7876a76a01c524ff16ae01c3a549babb44d7aff"} Jul 07 14:34:51.659942 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:51.659860 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:51.659942 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:51.659908 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:51.660593 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:51.659998 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6ms86" podUID="87de77ae-e1a1-4544-9f69-2660712a8c5a" Jul 07 14:34:51.660593 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:51.660161 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:51.660593 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:51.660258 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:34:51.660593 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:51.660340 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbjrz" podUID="78a88ab8-8271-4896-8c6b-3a7492211865" Jul 07 14:34:52.293088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:52.293053 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:52.293307 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.293237 2590 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:52.293377 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.293314 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret podName:78a88ab8-8271-4896-8c6b-3a7492211865 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.293292398 +0000 UTC m=+66.089399534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret") pod "global-pull-secret-syncer-lbjrz" (UID: "78a88ab8-8271-4896-8c6b-3a7492211865") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:34:52.393664 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:52.393612 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:52.393868 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.393782 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:52.393868 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.393861 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.393837763 +0000 UTC m=+66.189944904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:34:52.494724 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:52.494674 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:52.494919 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.494825 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:34:52.494919 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.494849 2590 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:34:52.494919 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.494862 2590 projected.go:196] Error preparing data for projected volume kube-api-access-vwzp5 for pod openshift-network-diagnostics/network-check-target-6ms86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:52.495069 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:52.494926 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5 podName:87de77ae-e1a1-4544-9f69-2660712a8c5a nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.494907733 +0000 UTC m=+66.291014866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwzp5" (UniqueName: "kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5") pod "network-check-target-6ms86" (UID: "87de77ae-e1a1-4544-9f69-2660712a8c5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:34:53.009134 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.009106 2590 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-126.ec2.internal" event="NodeReady" Jul 07 14:34:53.009719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.009281 2590 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:34:53.052329 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.052015 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-grhjw"] Jul 07 14:34:53.057787 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.057766 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:34:53.057922 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.057901 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.060760 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.060727 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 14:34:53.060905 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.060851 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 14:34:53.060975 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.060736 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-djhh4\"" Jul 07 14:34:53.061712 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.061693 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.063822 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.063766 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cs9m4"] Jul 07 14:34:53.064372 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.064351 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:34:53.064506 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.064352 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:34:53.064506 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.064498 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:34:53.064730 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.064601 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnl6d\"" Jul 07 14:34:53.068493 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.068467 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.069939 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.069617 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p8prz"] Jul 07 14:34:53.074465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.074032 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:34:53.074465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.074091 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntb78\"" Jul 07 14:34:53.074465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.074032 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:34:53.074465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.074384 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:34:53.074990 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.074959 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-grhjw"] Jul 07 14:34:53.077744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.076399 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.077744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.076898 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:34:53.080233 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.079770 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cs9m4"] Jul 07 14:34:53.082571 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.082179 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v5tsw\"" Jul 07 14:34:53.082571 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.082320 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:34:53.082571 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.082361 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:34:53.082571 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.082478 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:34:53.085768 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.085749 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p8prz"] Jul 07 14:34:53.200245 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200206 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200245 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200249 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.200507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200284 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdkc7\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200354 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fbea0de-dc74-41db-be92-cd573ec92d65-cert\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.200507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200460 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200486 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200502 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200523 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200560 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d67dc065-ea58-4e03-966b-ccaaa5283db9-config-volume\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200642 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6rs\" (UniqueName: \"kubernetes.io/projected/d67dc065-ea58-4e03-966b-ccaaa5283db9-kube-api-access-rn6rs\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200704 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200739 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db876ecd-081d-434e-b450-3255e528a2c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200762 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjh7n\" (UniqueName: \"kubernetes.io/projected/0fbea0de-dc74-41db-be92-cd573ec92d65-kube-api-access-cjh7n\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.200795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200780 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dc065-ea58-4e03-966b-ccaaa5283db9-tmp-dir\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.201061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200824 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.201061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.200856 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.301598 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301552 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.301598 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301594 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db876ecd-081d-434e-b450-3255e528a2c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.301598 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301610 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjh7n\" (UniqueName: \"kubernetes.io/projected/0fbea0de-dc74-41db-be92-cd573ec92d65-kube-api-access-cjh7n\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301703 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dc065-ea58-4e03-966b-ccaaa5283db9-tmp-dir\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301744 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301753 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301764 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301784 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301831 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:53.801807531 +0000 UTC m=+35.597914670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301870 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301878 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301899 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.301921 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301928 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:53.801912104 +0000 UTC m=+35.598019231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.301967 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.301972 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdkc7\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.302000 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:53.801989885 +0000 UTC m=+35.598097019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302034 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fbea0de-dc74-41db-be92-cd573ec92d65-cert\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302086 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302100 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dc065-ea58-4e03-966b-ccaaa5283db9-tmp-dir\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302112 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302134 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302152 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302175 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d67dc065-ea58-4e03-966b-ccaaa5283db9-config-volume\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.302412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302211 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6rs\" (UniqueName: \"kubernetes.io/projected/d67dc065-ea58-4e03-966b-ccaaa5283db9-kube-api-access-rn6rs\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.302997 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302537 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.302997 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302689 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db876ecd-081d-434e-b450-3255e528a2c7-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.302997 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.302984 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d67dc065-ea58-4e03-966b-ccaaa5283db9-config-volume\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.303122 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.303017 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.303248 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.303214 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.306735 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.306704 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.306735 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.306726 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.306735 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.306734 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fbea0de-dc74-41db-be92-cd573ec92d65-cert\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.311460 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.311430 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdkc7\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.311616 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.311431 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.311848 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.311818 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6rs\" (UniqueName: \"kubernetes.io/projected/d67dc065-ea58-4e03-966b-ccaaa5283db9-kube-api-access-rn6rs\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.311931 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.311847 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjh7n\" (UniqueName: \"kubernetes.io/projected/0fbea0de-dc74-41db-be92-cd573ec92d65-kube-api-access-cjh7n\") pod \"ingress-canary-cs9m4\" (UID: \"0fbea0de-dc74-41db-be92-cd573ec92d65\") " pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.393781 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.393745 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cs9m4" Jul 07 14:34:53.660268 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.660232 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:34:53.660451 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.660344 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:34:53.660451 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.660377 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:34:53.663041 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663008 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:34:53.663162 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663059 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:34:53.663162 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663102 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:34:53.663162 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663062 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:34:53.663789 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663767 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v8hh9\"" Jul 07 14:34:53.663924 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.663775 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhggt\"" Jul 07 14:34:53.807194 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.807158 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:53.807375 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807318 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:34:53.807438 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.807371 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:53.807438 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807391 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:54.807373493 +0000 UTC m=+36.603480621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:34:53.807554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:53.807444 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:53.807554 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807466 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:34:53.807554 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807481 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:34:53.807554 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807533 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:54.80751666 +0000 UTC m=+36.603623808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:34:53.807722 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807607 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:34:53.807722 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:53.807682 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:54.807660971 +0000 UTC m=+36.603768115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:34:54.400495 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.400342 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cs9m4"] Jul 07 14:34:54.404462 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:34:54.404435 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fbea0de_dc74_41db_be92_cd573ec92d65.slice/crio-2e00b1047ddb938676338b909b7940a4db6a67bfd64de63353ce7963e7a62044 WatchSource:0}: Error finding container 2e00b1047ddb938676338b909b7940a4db6a67bfd64de63353ce7963e7a62044: Status 404 returned error can't find the container with id 2e00b1047ddb938676338b909b7940a4db6a67bfd64de63353ce7963e7a62044 Jul 07 14:34:54.816171 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.816083 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:54.816171 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.816169 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.816196 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816241 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816275 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816284 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816297 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816309 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:56.816292465 +0000 UTC m=+38.612399593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816326 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:56.816319865 +0000 UTC m=+38.612426992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:34:54.816346 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:54.816336 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:34:56.816331404 +0000 UTC m=+38.612438532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:34:54.862714 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.862689 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="264a7b883ff026815747719ca1e0dccd1d55c551ecde221ef54f44ad7931c233" exitCode=0 Jul 07 14:34:54.862857 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.862760 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"264a7b883ff026815747719ca1e0dccd1d55c551ecde221ef54f44ad7931c233"} Jul 07 14:34:54.863802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:54.863781 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cs9m4" event={"ID":"0fbea0de-dc74-41db-be92-cd573ec92d65","Type":"ContainerStarted","Data":"2e00b1047ddb938676338b909b7940a4db6a67bfd64de63353ce7963e7a62044"} Jul 07 14:34:55.870425 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:55.870389 2590 generic.go:356] "Generic (PLEG): container finished" podID="aceb0b20-1ac5-42a6-8fb2-9e478d9325e5" containerID="7cd04e3c9a84f317dc5208ab799aaa35d98ff4757fee4430993cd69b8753bf33" exitCode=0 Jul 07 14:34:55.870933 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:55.870461 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerDied","Data":"7cd04e3c9a84f317dc5208ab799aaa35d98ff4757fee4430993cd69b8753bf33"} Jul 07 14:34:56.836018 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:56.835962 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:34:56.836203 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:56.836031 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:34:56.836203 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:56.836077 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:34:56.836203 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836136 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:34:56.836203 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836160 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:34:56.836203 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836193 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:34:56.836475 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836223 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:00.836205322 +0000 UTC m=+42.632312450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:34:56.836475 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836248 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:00.836231474 +0000 UTC m=+42.632338621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:34:56.836475 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836195 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:34:56.836475 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:34:56.836291 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:00.83628047 +0000 UTC m=+42.632387599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:34:56.878364 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:56.878112 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8svzx" event={"ID":"aceb0b20-1ac5-42a6-8fb2-9e478d9325e5","Type":"ContainerStarted","Data":"80766ad93f3e404669e51f024a5785cec3aaad8ea8bb8667d4992db988abd116"} Jul 07 14:34:56.905863 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:56.905773 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8svzx" podStartSLOduration=16.313858699 podStartE2EDuration="38.905756267s" totalImagesPullingTime="22.591897568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:56.904468777 +0000 UTC m=+38.700575929" watchObservedRunningTime="2026-07-07 14:34:56.905756267 +0000 UTC m=+38.701863416" Jul 07 14:34:57.881848 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:57.881760 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cs9m4" event={"ID":"0fbea0de-dc74-41db-be92-cd573ec92d65","Type":"ContainerStarted","Data":"6143151a31f5dc9ff0a1b3e566de5a67fd45018a29c323c5babceafc171172ea"} Jul 07 14:34:57.898889 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:34:57.898729 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cs9m4" podStartSLOduration=1.84103192 podStartE2EDuration="4.898710629s" totalImagesPullingTime="3.057678709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:57.898438655 +0000 UTC m=+39.694545816" watchObservedRunningTime="2026-07-07 14:34:57.898710629 +0000 UTC m=+39.694817779" Jul 07 14:35:00.868696 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:00.868640 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:00.868711 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:00.868744 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868806 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868829 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868851 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868856 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868887 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:08.868869805 +0000 UTC m=+50.664976935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868903 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:08.868896914 +0000 UTC m=+50.665004042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:35:00.869062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:00.868914 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:08.868909116 +0000 UTC m=+50.665016244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:35:08.936149 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:08.936112 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:08.936155 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:08.936188 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936267 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936315 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.936301479 +0000 UTC m=+66.732408607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936268 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936385 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.936370737 +0000 UTC m=+66.732477869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936265 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936402 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:35:08.936695 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:08.936432 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:24.936425476 +0000 UTC m=+66.732532604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:35:18.855356 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:18.855328 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tqvd7" Jul 07 14:35:24.342130 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.342072 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:35:24.345068 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.345044 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:35:24.356987 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.356954 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78a88ab8-8271-4896-8c6b-3a7492211865-original-pull-secret\") pod \"global-pull-secret-syncer-lbjrz\" (UID: \"78a88ab8-8271-4896-8c6b-3a7492211865\") " pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:35:24.442910 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.442869 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:35:24.445627 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.445609 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:35:24.453704 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.453683 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:35:24.453801 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.453747 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:36:28.453730381 +0000 UTC m=+130.249837510 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : secret "metrics-daemon-secret" not found Jul 07 14:35:24.543173 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.543128 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:35:24.545866 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.545846 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:35:24.556114 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.556086 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:35:24.566641 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.566616 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwzp5\" (UniqueName: \"kubernetes.io/projected/87de77ae-e1a1-4544-9f69-2660712a8c5a-kube-api-access-vwzp5\") pod \"network-check-target-6ms86\" (UID: \"87de77ae-e1a1-4544-9f69-2660712a8c5a\") " pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:35:24.572393 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.572374 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbjrz" Jul 07 14:35:24.583815 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.583785 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhggt\"" Jul 07 14:35:24.591522 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.591494 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:35:24.719451 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.719420 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lbjrz"] Jul 07 14:35:24.722895 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:35:24.722867 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a88ab8_8271_4896_8c6b_3a7492211865.slice/crio-5667fdc47213275931d550eab283679e354f445f6d893e3ab67dbc839e801793 WatchSource:0}: Error finding container 5667fdc47213275931d550eab283679e354f445f6d893e3ab67dbc839e801793: Status 404 returned error can't find the container with id 5667fdc47213275931d550eab283679e354f445f6d893e3ab67dbc839e801793 Jul 07 14:35:24.744044 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.744017 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6ms86"] Jul 07 14:35:24.747219 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:35:24.747196 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87de77ae_e1a1_4544_9f69_2660712a8c5a.slice/crio-d8f3c188185b000124662fabefcd72bb940a6eef72b2c262910990b08c2f417a WatchSource:0}: Error finding container d8f3c188185b000124662fabefcd72bb940a6eef72b2c262910990b08c2f417a: Status 404 returned error can't find the container with id d8f3c188185b000124662fabefcd72bb940a6eef72b2c262910990b08c2f417a Jul 07 14:35:24.944568 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.944531 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lbjrz" event={"ID":"78a88ab8-8271-4896-8c6b-3a7492211865","Type":"ContainerStarted","Data":"5667fdc47213275931d550eab283679e354f445f6d893e3ab67dbc839e801793"} Jul 07 14:35:24.945609 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.945587 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ms86" event={"ID":"87de77ae-e1a1-4544-9f69-2660712a8c5a","Type":"ContainerStarted","Data":"d8f3c188185b000124662fabefcd72bb940a6eef72b2c262910990b08c2f417a"} Jul 07 14:35:24.946887 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.946867 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:35:24.946954 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.946924 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:35:24.946991 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:24.946952 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:35:24.947030 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947015 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:35:24.947073 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947048 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:35:24.947103 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947074 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:35:24.947103 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947087 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:35:24.947175 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947075 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:56.947059769 +0000 UTC m=+98.743166897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:35:24.947175 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947135 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:56.947122973 +0000 UTC m=+98.743230105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:35:24.947175 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:24.947145 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:35:56.947139813 +0000 UTC m=+98.743246941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:35:29.960372 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:29.960330 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lbjrz" event={"ID":"78a88ab8-8271-4896-8c6b-3a7492211865","Type":"ContainerStarted","Data":"3473fbe7e82d4e199a8fd99e80a68c649775e8cc581472e7daa1cf4fd51d8a2e"} Jul 07 14:35:29.961790 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:29.961763 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6ms86" event={"ID":"87de77ae-e1a1-4544-9f69-2660712a8c5a","Type":"ContainerStarted","Data":"ddfae174883a671f414ccbc788b5f716141e904d34abc8ea7bac574b21062478"} Jul 07 14:35:29.961908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:29.961896 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:35:29.977039 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:29.976995 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lbjrz" podStartSLOduration=67.184075591 podStartE2EDuration="1m11.976981926s" totalImagesPullingTime="4.792906335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:35:29.976015067 +0000 UTC m=+71.772122221" watchObservedRunningTime="2026-07-07 14:35:29.976981926 +0000 UTC m=+71.773089073" Jul 07 14:35:29.995154 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:29.995103 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6ms86" podStartSLOduration=67.230943091 podStartE2EDuration="1m11.995086947s" totalImagesPullingTime="4.764143856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:35:29.994316474 +0000 UTC m=+71.790423626" watchObservedRunningTime="2026-07-07 14:35:29.995086947 +0000 UTC m=+71.791194096" Jul 07 14:35:56.995051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:56.994909 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:35:56.995051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:56.994959 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:35:56.995051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:35:56.995004 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995075 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995093 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995096 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995134 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995163 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:37:00.995144489 +0000 UTC m=+162.791251623 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995182 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:37:00.995173463 +0000 UTC m=+162.791280590 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:35:56.995582 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:35:56.995202 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:37:00.995187878 +0000 UTC m=+162.791295006 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:36:00.966595 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:00.966565 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6ms86" Jul 07 14:36:26.832544 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.832503 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd"] Jul 07 14:36:26.835561 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.835537 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:26.838201 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.838170 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 14:36:26.838336 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.838178 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 14:36:26.838890 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.838876 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 14:36:26.838968 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.838923 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 14:36:26.847987 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.847954 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd"] Jul 07 14:36:26.907995 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.907961 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmp2q\" (UniqueName: \"kubernetes.io/projected/266e3d91-3728-47f8-859d-46ac4e69e92e-kube-api-access-cmp2q\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:26.908182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.908002 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/266e3d91-3728-47f8-859d-46ac4e69e92e-tmp\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:26.908182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:26.908090 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/266e3d91-3728-47f8-859d-46ac4e69e92e-klusterlet-config\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.008792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.008756 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmp2q\" (UniqueName: \"kubernetes.io/projected/266e3d91-3728-47f8-859d-46ac4e69e92e-kube-api-access-cmp2q\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.008940 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.008797 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/266e3d91-3728-47f8-859d-46ac4e69e92e-tmp\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.008940 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.008837 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/266e3d91-3728-47f8-859d-46ac4e69e92e-klusterlet-config\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.009207 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.009181 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/266e3d91-3728-47f8-859d-46ac4e69e92e-tmp\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.011343 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.011318 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/266e3d91-3728-47f8-859d-46ac4e69e92e-klusterlet-config\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.018719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.018690 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmp2q\" (UniqueName: \"kubernetes.io/projected/266e3d91-3728-47f8-859d-46ac4e69e92e-kube-api-access-cmp2q\") pod \"klusterlet-addon-workmgr-74865f8d8f-kttfd\" (UID: \"266e3d91-3728-47f8-859d-46ac4e69e92e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.145032 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.144931 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:27.275400 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:27.275289 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd"] Jul 07 14:36:27.280036 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:36:27.280005 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266e3d91_3728_47f8_859d_46ac4e69e92e.slice/crio-12db5e6e417e8a0f366837071e8d869f9aab361bd878dfe8975bd711ddb96ab4 WatchSource:0}: Error finding container 12db5e6e417e8a0f366837071e8d869f9aab361bd878dfe8975bd711ddb96ab4: Status 404 returned error can't find the container with id 12db5e6e417e8a0f366837071e8d869f9aab361bd878dfe8975bd711ddb96ab4 Jul 07 14:36:28.100310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:28.100271 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" event={"ID":"266e3d91-3728-47f8-859d-46ac4e69e92e","Type":"ContainerStarted","Data":"12db5e6e417e8a0f366837071e8d869f9aab361bd878dfe8975bd711ddb96ab4"} Jul 07 14:36:28.521531 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:28.521488 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:36:28.521770 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:28.521753 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:36:28.521852 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:28.521842 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:30.521820127 +0000 UTC m=+252.317927279 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : secret "metrics-daemon-secret" not found Jul 07 14:36:31.109557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:31.109513 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" event={"ID":"266e3d91-3728-47f8-859d-46ac4e69e92e","Type":"ContainerStarted","Data":"58cd5337d364617a4cf97b35f01ff5976a4f3f7df711fbe0056272f4afa9d5f1"} Jul 07 14:36:31.109960 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:31.109708 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:31.111388 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:31.111364 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:36:31.130740 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:31.130695 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" podStartSLOduration=1.431966629 podStartE2EDuration="5.13068246s" totalImagesPullingTime="3.698715831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:31.129100021 +0000 UTC m=+132.925207172" watchObservedRunningTime="2026-07-07 14:36:31.13068246 +0000 UTC m=+132.926789609" Jul 07 14:36:56.073014 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:56.072965 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" podUID="db876ecd-081d-434e-b450-3255e528a2c7" Jul 07 14:36:56.084176 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:56.084131 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" Jul 07 14:36:56.098746 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:56.098709 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p8prz" podUID="d67dc065-ea58-4e03-966b-ccaaa5283db9" Jul 07 14:36:56.169795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:56.169764 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:36:56.169795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:56.169777 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:36:56.169795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:36:56.169764 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8prz" Jul 07 14:36:56.686278 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:36:56.686231 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:37:01.057834 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:37:01.057798 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:37:01.057846 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.057939 2590 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.057960 2590 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.057980 2590 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67cdf6fcf9-bsz8x: secret "image-registry-tls" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.057985 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls podName:d67dc065-ea58-4e03-966b-ccaaa5283db9 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:03.057972357 +0000 UTC m=+284.854079484 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls") pod "dns-default-p8prz" (UID: "d67dc065-ea58-4e03-966b-ccaaa5283db9") : secret "dns-default-metrics-tls" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:37:01.058029 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.058058 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls podName:2373444e-c9ce-4aba-9f09-ef1a7886cf63 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:03.058044768 +0000 UTC m=+284.854151897 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls") pod "image-registry-67cdf6fcf9-bsz8x" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63") : secret "image-registry-tls" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.058119 2590 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:37:01.058201 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:37:01.058175 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert podName:db876ecd-081d-434e-b450-3255e528a2c7 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:03.058159581 +0000 UTC m=+284.854266726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-grhjw" (UID: "db876ecd-081d-434e-b450-3255e528a2c7") : secret "networking-console-plugin-cert" not found Jul 07 14:37:08.662437 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:37:08.662391 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:38:30.598407 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:30.598369 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:38:30.598900 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:30.598520 2590 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:38:30.598900 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:30.598596 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs podName:4dc76eb3-2ae2-4d44-bb57-55964b190580 nodeName:}" failed. No retries permitted until 2026-07-07 14:40:32.598579211 +0000 UTC m=+374.394686343 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs") pod "network-metrics-daemon-cbmr8" (UID: "4dc76eb3-2ae2-4d44-bb57-55964b190580") : secret "metrics-daemon-secret" not found Jul 07 14:38:31.110965 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:31.110913 2590 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" podUID="266e3d91-3728-47f8-859d-46ac4e69e92e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 07 14:38:31.389951 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:31.389864 2590 generic.go:356] "Generic (PLEG): container finished" podID="266e3d91-3728-47f8-859d-46ac4e69e92e" containerID="58cd5337d364617a4cf97b35f01ff5976a4f3f7df711fbe0056272f4afa9d5f1" exitCode=1 Jul 07 14:38:31.389951 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:31.389935 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" event={"ID":"266e3d91-3728-47f8-859d-46ac4e69e92e","Type":"ContainerDied","Data":"58cd5337d364617a4cf97b35f01ff5976a4f3f7df711fbe0056272f4afa9d5f1"} Jul 07 14:38:31.390284 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:31.390268 2590 scope.go:117] "RemoveContainer" containerID="58cd5337d364617a4cf97b35f01ff5976a4f3f7df711fbe0056272f4afa9d5f1" Jul 07 14:38:32.393976 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:32.393942 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" event={"ID":"266e3d91-3728-47f8-859d-46ac4e69e92e","Type":"ContainerStarted","Data":"52d315a75dc0b3bf7077c188bca66849e997ef46594c6568d70d5cf186ed2441"} Jul 07 14:38:32.394481 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:32.394311 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:38:32.394941 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:32.394922 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74865f8d8f-kttfd" Jul 07 14:38:34.370024 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.369990 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7bw74"] Jul 07 14:38:34.372947 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.372928 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.375487 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.375463 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 14:38:34.375593 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.375470 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 14:38:34.375593 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.375475 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:38:34.375884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.375865 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:38:34.376750 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.376730 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hbcct\"" Jul 07 14:38:34.383105 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.383087 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 14:38:34.393148 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.393122 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7bw74"] Jul 07 14:38:34.428749 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.428715 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.428749 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.428754 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-tmp\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.428950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.428856 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd583e-e59a-4ea7-8a11-4ded2195a28e-serving-cert\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.428950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.428902 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.428950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.428942 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwx9d\" (UniqueName: \"kubernetes.io/projected/58dd583e-e59a-4ea7-8a11-4ded2195a28e-kube-api-access-qwx9d\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.429045 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.429001 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-snapshots\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530219 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530181 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530219 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530219 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-tmp\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530421 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530262 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd583e-e59a-4ea7-8a11-4ded2195a28e-serving-cert\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530421 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530320 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530421 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530373 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwx9d\" (UniqueName: \"kubernetes.io/projected/58dd583e-e59a-4ea7-8a11-4ded2195a28e-kube-api-access-qwx9d\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530638 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530519 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-snapshots\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530747 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530731 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-tmp\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.530880 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.530861 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.531124 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.531102 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58dd583e-e59a-4ea7-8a11-4ded2195a28e-snapshots\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.531208 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.531193 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58dd583e-e59a-4ea7-8a11-4ded2195a28e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.532977 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.532960 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd583e-e59a-4ea7-8a11-4ded2195a28e-serving-cert\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.542781 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.542754 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwx9d\" (UniqueName: \"kubernetes.io/projected/58dd583e-e59a-4ea7-8a11-4ded2195a28e-kube-api-access-qwx9d\") pod \"insights-operator-5c847dcfc4-7bw74\" (UID: \"58dd583e-e59a-4ea7-8a11-4ded2195a28e\") " pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.682211 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.682175 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" Jul 07 14:38:34.810667 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:34.810620 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7bw74"] Jul 07 14:38:34.813875 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:38:34.813841 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dd583e_e59a_4ea7_8a11_4ded2195a28e.slice/crio-5cdcac3b40895fadef3329a4aec41e167c707502b2d7cd878c4d4ecdb33a5c0f WatchSource:0}: Error finding container 5cdcac3b40895fadef3329a4aec41e167c707502b2d7cd878c4d4ecdb33a5c0f: Status 404 returned error can't find the container with id 5cdcac3b40895fadef3329a4aec41e167c707502b2d7cd878c4d4ecdb33a5c0f Jul 07 14:38:35.403297 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:35.403262 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" event={"ID":"58dd583e-e59a-4ea7-8a11-4ded2195a28e","Type":"ContainerStarted","Data":"5cdcac3b40895fadef3329a4aec41e167c707502b2d7cd878c4d4ecdb33a5c0f"} Jul 07 14:38:37.414531 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:37.414492 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" event={"ID":"58dd583e-e59a-4ea7-8a11-4ded2195a28e","Type":"ContainerStarted","Data":"f134928bdf275d84c2b34a9cafdbd9b76fdf04e41bc620c0509cfbe69cbb0c9a"} Jul 07 14:38:37.432237 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:37.432183 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" podStartSLOduration=1.394019528 podStartE2EDuration="3.432165476s" totalImagesPullingTime="2.038145948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:37.431194785 +0000 UTC m=+259.227301935" watchObservedRunningTime="2026-07-07 14:38:37.432165476 +0000 UTC m=+259.228272624" Jul 07 14:38:38.343766 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.343733 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4kjct"] Jul 07 14:38:38.346871 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.346856 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.353470 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.353451 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s99qs\"" Jul 07 14:38:38.355384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.355364 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:38:38.355940 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.355926 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:38:38.380732 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.380700 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kjct"] Jul 07 14:38:38.461317 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.461286 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gfkf\" (UniqueName: \"kubernetes.io/projected/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-api-access-4gfkf\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.461744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.461337 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.461744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.461363 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.461744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.461380 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-crio-socket\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.461744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.461398 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-data-volume\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.561903 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.561858 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gfkf\" (UniqueName: \"kubernetes.io/projected/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-api-access-4gfkf\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562083 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562013 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562083 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562070 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562195 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562090 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-crio-socket\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562195 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562110 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-data-volume\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562195 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:38.562142 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:38.562335 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562189 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-crio-socket\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.562335 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:38.562145 2590 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:38:38.562335 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:38.562221 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:39.062200083 +0000 UTC m=+260.858307211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:38.562335 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:38.562295 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:39.062276549 +0000 UTC m=+260.858383693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : configmap "kube-rbac-proxy" not found Jul 07 14:38:38.562491 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.562436 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-data-volume\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.574808 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.574780 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gfkf\" (UniqueName: \"kubernetes.io/projected/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-api-access-4gfkf\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:38.714175 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.714139 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh"] Jul 07 14:38:38.717096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.717080 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" Jul 07 14:38:38.724967 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.724950 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jw2w2\"" Jul 07 14:38:38.727828 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.727813 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 14:38:38.728103 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.728090 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 14:38:38.766850 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.766822 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh"] Jul 07 14:38:38.864397 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.864364 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjb9c\" (UniqueName: \"kubernetes.io/projected/976e325e-8808-46de-ac37-692630d153ca-kube-api-access-vjb9c\") pod \"migrator-d57d58cc9-tq6nh\" (UID: \"976e325e-8808-46de-ac37-692630d153ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" Jul 07 14:38:38.965523 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.965417 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjb9c\" (UniqueName: \"kubernetes.io/projected/976e325e-8808-46de-ac37-692630d153ca-kube-api-access-vjb9c\") pod \"migrator-d57d58cc9-tq6nh\" (UID: \"976e325e-8808-46de-ac37-692630d153ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" Jul 07 14:38:38.974788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:38.974761 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjb9c\" (UniqueName: \"kubernetes.io/projected/976e325e-8808-46de-ac37-692630d153ca-kube-api-access-vjb9c\") pod \"migrator-d57d58cc9-tq6nh\" (UID: \"976e325e-8808-46de-ac37-692630d153ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" Jul 07 14:38:39.026015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:39.025987 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" Jul 07 14:38:39.066137 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:39.066103 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:39.066287 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:39.066161 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:39.066287 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:39.066250 2590 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:38:39.066287 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:39.066261 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:39.066388 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:39.066334 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:40.06631146 +0000 UTC m=+261.862418605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:39.066388 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:39.066358 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:40.066347553 +0000 UTC m=+261.862454688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : configmap "kube-rbac-proxy" not found Jul 07 14:38:39.152160 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:39.152128 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh"] Jul 07 14:38:39.156032 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:38:39.155981 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976e325e_8808_46de_ac37_692630d153ca.slice/crio-026055c952874bcac26b9018072e850d085e1f9a8485c27b758b929ba9efb15e WatchSource:0}: Error finding container 026055c952874bcac26b9018072e850d085e1f9a8485c27b758b929ba9efb15e: Status 404 returned error can't find the container with id 026055c952874bcac26b9018072e850d085e1f9a8485c27b758b929ba9efb15e Jul 07 14:38:39.422308 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:39.422274 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" event={"ID":"976e325e-8808-46de-ac37-692630d153ca","Type":"ContainerStarted","Data":"026055c952874bcac26b9018072e850d085e1f9a8485c27b758b929ba9efb15e"} Jul 07 14:38:40.073612 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:40.073567 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:40.074047 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:40.073620 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:40.074047 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:40.073742 2590 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:38:40.074047 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:40.073758 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:40.074047 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:40.073813 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:42.073796462 +0000 UTC m=+263.869903590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : configmap "kube-rbac-proxy" not found Jul 07 14:38:40.074047 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:40.073827 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:42.07382101 +0000 UTC m=+263.869928138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:40.515873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:40.515843 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdmlz_908f7ea3-b315-4a93-a41c-c60d7706443e/dns-node-resolver/0.log" Jul 07 14:38:41.315095 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:41.315074 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rw669_673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee/node-ca/0.log" Jul 07 14:38:41.431635 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:41.431601 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" event={"ID":"976e325e-8808-46de-ac37-692630d153ca","Type":"ContainerStarted","Data":"5264a22355fafc95cd6675b87278195f1ebcfc53ec9b94a748c93ab388bcef4e"} Jul 07 14:38:41.431788 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:41.431672 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" event={"ID":"976e325e-8808-46de-ac37-692630d153ca","Type":"ContainerStarted","Data":"5a6aba8890596a3913a5ffa5e26b0b385c676f83d9a718d5c4a8343ca44f2d72"} Jul 07 14:38:41.449821 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:41.449769 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tq6nh" podStartSLOduration=1.338181886 podStartE2EDuration="3.449753533s" totalImagesPullingTime="2.111571647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:41.448738767 +0000 UTC m=+263.244845916" watchObservedRunningTime="2026-07-07 14:38:41.449753533 +0000 UTC m=+263.245860682" Jul 07 14:38:42.093830 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:42.093789 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:42.094041 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:42.093910 2590 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:38:42.094041 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:42.093973 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:46.0939579 +0000 UTC m=+267.890065028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : configmap "kube-rbac-proxy" not found Jul 07 14:38:42.094145 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:42.094036 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:42.094145 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:42.094136 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:42.094215 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:42.094165 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:46.094157974 +0000 UTC m=+267.890265102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:42.125786 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:42.125745 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cs9m4_0fbea0de-dc74-41db-be92-cd573ec92d65/serve-healthcheck-canary/0.log" Jul 07 14:38:46.128060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:46.128002 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:46.128060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:46.128065 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:46.128514 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:46.128177 2590 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:38:46.128514 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:46.128178 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:46.128514 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:46.128230 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:54.12821595 +0000 UTC m=+275.924323081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : configmap "kube-rbac-proxy" not found Jul 07 14:38:46.128514 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:46.128243 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:38:54.128236919 +0000 UTC m=+275.924344048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:54.192698 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:54.192634 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:54.192698 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:54.192706 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:54.193173 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:54.192807 2590 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:38:54.193173 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:54.192891 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls podName:4d5b60d6-5b71-40cf-a0da-5f6d3fece667 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:10.192868724 +0000 UTC m=+291.988975852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kjct" (UID: "4d5b60d6-5b71-40cf-a0da-5f6d3fece667") : secret "insights-runtime-extractor-tls" not found Jul 07 14:38:54.193358 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:54.193340 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:38:59.170663 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:59.170612 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p8prz" podUID="d67dc065-ea58-4e03-966b-ccaaa5283db9" Jul 07 14:38:59.170663 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:59.170612 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" podUID="db876ecd-081d-434e-b450-3255e528a2c7" Jul 07 14:38:59.170663 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:38:59.170620 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" Jul 07 14:38:59.484538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:59.484453 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8prz" Jul 07 14:38:59.484706 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:59.484453 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:38:59.484706 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:38:59.484465 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:39:03.064815 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.064774 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:03.065287 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.064845 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:39:03.065287 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.064878 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:39:03.067192 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.067170 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d67dc065-ea58-4e03-966b-ccaaa5283db9-metrics-tls\") pod \"dns-default-p8prz\" (UID: \"d67dc065-ea58-4e03-966b-ccaaa5283db9\") " pod="openshift-dns/dns-default-p8prz" Jul 07 14:39:03.067278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.067244 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"image-registry-67cdf6fcf9-bsz8x\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:03.067366 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.067345 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db876ecd-081d-434e-b450-3255e528a2c7-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-grhjw\" (UID: \"db876ecd-081d-434e-b450-3255e528a2c7\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:39:03.088693 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.088662 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v5tsw\"" Jul 07 14:39:03.088693 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.088685 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-djhh4\"" Jul 07 14:39:03.088693 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.088698 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnl6d\"" Jul 07 14:39:03.095842 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.095825 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:03.095918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.095851 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" Jul 07 14:39:03.095918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.095914 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p8prz" Jul 07 14:39:03.255007 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.254964 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p8prz"] Jul 07 14:39:03.257625 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:03.257601 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67dc065_ea58_4e03_966b_ccaaa5283db9.slice/crio-c31b813c5b018e140b083568d48919895e699c8514182ff59ec76753a69edc81 WatchSource:0}: Error finding container c31b813c5b018e140b083568d48919895e699c8514182ff59ec76753a69edc81: Status 404 returned error can't find the container with id c31b813c5b018e140b083568d48919895e699c8514182ff59ec76753a69edc81 Jul 07 14:39:03.477680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.477630 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-grhjw"] Jul 07 14:39:03.481043 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.481018 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:39:03.481501 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:03.481478 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb876ecd_081d_434e_b450_3255e528a2c7.slice/crio-3e55402ccf691e221dc47762a79285a507eed7893bed97b6793cc3a785197f9b WatchSource:0}: Error finding container 3e55402ccf691e221dc47762a79285a507eed7893bed97b6793cc3a785197f9b: Status 404 returned error can't find the container with id 3e55402ccf691e221dc47762a79285a507eed7893bed97b6793cc3a785197f9b Jul 07 14:39:03.484929 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:03.484904 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2373444e_c9ce_4aba_9f09_ef1a7886cf63.slice/crio-2cf46dfe88d3d424cc1c7862a6912ad2796cfd8d4006701cede9bc6e1490b387 WatchSource:0}: Error finding container 2cf46dfe88d3d424cc1c7862a6912ad2796cfd8d4006701cede9bc6e1490b387: Status 404 returned error can't find the container with id 2cf46dfe88d3d424cc1c7862a6912ad2796cfd8d4006701cede9bc6e1490b387 Jul 07 14:39:03.497315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.497284 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8prz" event={"ID":"d67dc065-ea58-4e03-966b-ccaaa5283db9","Type":"ContainerStarted","Data":"c31b813c5b018e140b083568d48919895e699c8514182ff59ec76753a69edc81"} Jul 07 14:39:03.498558 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.498430 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" event={"ID":"2373444e-c9ce-4aba-9f09-ef1a7886cf63","Type":"ContainerStarted","Data":"2cf46dfe88d3d424cc1c7862a6912ad2796cfd8d4006701cede9bc6e1490b387"} Jul 07 14:39:03.499456 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.499433 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" event={"ID":"db876ecd-081d-434e-b450-3255e528a2c7","Type":"ContainerStarted","Data":"3e55402ccf691e221dc47762a79285a507eed7893bed97b6793cc3a785197f9b"} Jul 07 14:39:03.682272 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.682240 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-nnb5d"] Jul 07 14:39:03.684105 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.684085 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:03.686676 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.686607 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t67cx\"" Jul 07 14:39:03.686882 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.686868 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:39:03.686963 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.686941 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:39:03.701331 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.701299 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-nnb5d"] Jul 07 14:39:03.772121 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.772030 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzqp\" (UniqueName: \"kubernetes.io/projected/81b6b607-d3d4-42b8-9c45-328dacccd584-kube-api-access-lqzqp\") pod \"downloads-685bfb5f64-nnb5d\" (UID: \"81b6b607-d3d4-42b8-9c45-328dacccd584\") " pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:03.872950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.872915 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzqp\" (UniqueName: \"kubernetes.io/projected/81b6b607-d3d4-42b8-9c45-328dacccd584-kube-api-access-lqzqp\") pod \"downloads-685bfb5f64-nnb5d\" (UID: \"81b6b607-d3d4-42b8-9c45-328dacccd584\") " pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:03.885855 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.885820 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzqp\" (UniqueName: \"kubernetes.io/projected/81b6b607-d3d4-42b8-9c45-328dacccd584-kube-api-access-lqzqp\") pod \"downloads-685bfb5f64-nnb5d\" (UID: \"81b6b607-d3d4-42b8-9c45-328dacccd584\") " pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:03.994994 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:03.994961 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:04.141193 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:04.141159 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-nnb5d"] Jul 07 14:39:04.145546 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:04.145515 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b6b607_d3d4_42b8_9c45_328dacccd584.slice/crio-fcb565b508f74299e8400291333f5b1eaca53d1d1ab737502fa575489cdb3fa7 WatchSource:0}: Error finding container fcb565b508f74299e8400291333f5b1eaca53d1d1ab737502fa575489cdb3fa7: Status 404 returned error can't find the container with id fcb565b508f74299e8400291333f5b1eaca53d1d1ab737502fa575489cdb3fa7 Jul 07 14:39:04.506067 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:04.505970 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" event={"ID":"2373444e-c9ce-4aba-9f09-ef1a7886cf63","Type":"ContainerStarted","Data":"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b"} Jul 07 14:39:04.506268 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:04.506137 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:04.507512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:04.507483 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-nnb5d" event={"ID":"81b6b607-d3d4-42b8-9c45-328dacccd584","Type":"ContainerStarted","Data":"fcb565b508f74299e8400291333f5b1eaca53d1d1ab737502fa575489cdb3fa7"} Jul 07 14:39:04.533606 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:04.533524 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" podStartSLOduration=285.533499714 podStartE2EDuration="4m45.533499714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:04.533100496 +0000 UTC m=+286.329207655" watchObservedRunningTime="2026-07-07 14:39:04.533499714 +0000 UTC m=+286.329606865" Jul 07 14:39:05.512833 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.512727 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8prz" event={"ID":"d67dc065-ea58-4e03-966b-ccaaa5283db9","Type":"ContainerStarted","Data":"ae420b75e7abd753902e6ec1b3b560147454d80979309519583eb8524d64cd4c"} Jul 07 14:39:05.512833 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.512797 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p8prz" event={"ID":"d67dc065-ea58-4e03-966b-ccaaa5283db9","Type":"ContainerStarted","Data":"9068cf752b9b58f60c3a5e2607a135afe18c3211c516b5990fc981f9cd3308c3"} Jul 07 14:39:05.513320 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.512960 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p8prz" Jul 07 14:39:05.514521 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.514491 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" event={"ID":"db876ecd-081d-434e-b450-3255e528a2c7","Type":"ContainerStarted","Data":"29f322ea4d219380945cbe120f527d00473b623d354d52fca0f8681756da74cf"} Jul 07 14:39:05.529785 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.529732 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p8prz" podStartSLOduration=250.569508629 podStartE2EDuration="4m12.529714459s" totalImagesPullingTime="1.96020583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:05.529269338 +0000 UTC m=+287.325376488" watchObservedRunningTime="2026-07-07 14:39:05.529714459 +0000 UTC m=+287.325821599" Jul 07 14:39:05.545432 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:05.545363 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-grhjw" podStartSLOduration=270.814476613 podStartE2EDuration="4m32.545339477s" totalImagesPullingTime="1.730862864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:05.544665048 +0000 UTC m=+287.340772195" watchObservedRunningTime="2026-07-07 14:39:05.545339477 +0000 UTC m=+287.341446628" Jul 07 14:39:09.524532 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.524496 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g"] Jul 07 14:39:09.530382 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.530357 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:09.532802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.532770 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 14:39:09.532802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.532790 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vnpbs\"" Jul 07 14:39:09.536996 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.536959 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g"] Jul 07 14:39:09.625044 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.625008 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f7p6g\" (UID: \"6bd1caf1-082b-43aa-95af-b63623077897\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:09.725395 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:09.725357 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f7p6g\" (UID: \"6bd1caf1-082b-43aa-95af-b63623077897\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:09.725588 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:09.725517 2590 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 14:39:09.725588 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:09.725586 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates podName:6bd1caf1-082b-43aa-95af-b63623077897 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:10.225566914 +0000 UTC m=+292.021674042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-f7p6g" (UID: "6bd1caf1-082b-43aa-95af-b63623077897") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 14:39:10.229665 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.229615 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f7p6g\" (UID: \"6bd1caf1-082b-43aa-95af-b63623077897\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:10.229904 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.229711 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:39:10.232386 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.232356 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4d5b60d6-5b71-40cf-a0da-5f6d3fece667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kjct\" (UID: \"4d5b60d6-5b71-40cf-a0da-5f6d3fece667\") " pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:39:10.232540 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.232519 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6bd1caf1-082b-43aa-95af-b63623077897-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f7p6g\" (UID: \"6bd1caf1-082b-43aa-95af-b63623077897\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:10.441814 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.441776 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:10.455932 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.455902 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kjct" Jul 07 14:39:10.598235 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.596950 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g"] Jul 07 14:39:10.622842 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.622800 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kjct"] Jul 07 14:39:10.626720 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:10.626696 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5b60d6_5b71_40cf_a0da_5f6d3fece667.slice/crio-7fee0b3515d81fc9909a587b19c1b4e6029a95a70cfb675e54bc26b3a4cc37e0 WatchSource:0}: Error finding container 7fee0b3515d81fc9909a587b19c1b4e6029a95a70cfb675e54bc26b3a4cc37e0: Status 404 returned error can't find the container with id 7fee0b3515d81fc9909a587b19c1b4e6029a95a70cfb675e54bc26b3a4cc37e0 Jul 07 14:39:10.763735 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.763635 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:10.768182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.768153 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.771152 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.770930 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:39:10.771152 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.770971 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:39:10.771152 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.771022 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:39:10.771152 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.771071 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:39:10.771439 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.771271 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:39:10.771499 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.771450 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7svhg\"" Jul 07 14:39:10.778942 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.778919 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:10.834329 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834293 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.834511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834349 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.834511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834398 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm76x\" (UniqueName: \"kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.834511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834446 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.834511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834475 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.834733 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.834512 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935711 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935678 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935735 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935761 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm76x\" (UniqueName: \"kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935793 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935817 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.935914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.935851 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.936503 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.936475 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.936628 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.936552 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.936724 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.936695 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.938535 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.938511 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.938639 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.938596 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:10.944416 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:10.944387 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm76x\" (UniqueName: \"kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x\") pod \"console-757b9c486d-7c6z8\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:11.079968 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:11.079865 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:11.245755 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:11.245673 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:11.254022 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:11.253985 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8263992_6d6a_4e0d_b981_63ffe596c6eb.slice/crio-bfb82adf59e9f3add48d62b55e527fae4bf7b1b79d76a7a095916d4d66f027ae WatchSource:0}: Error finding container bfb82adf59e9f3add48d62b55e527fae4bf7b1b79d76a7a095916d4d66f027ae: Status 404 returned error can't find the container with id bfb82adf59e9f3add48d62b55e527fae4bf7b1b79d76a7a095916d4d66f027ae Jul 07 14:39:11.544687 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:11.544623 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" event={"ID":"6bd1caf1-082b-43aa-95af-b63623077897","Type":"ContainerStarted","Data":"42fd4e91afcb459725667481b232703daccf0b4b9ac780a36f441f33d12f21d3"} Jul 07 14:39:11.548234 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:11.548194 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757b9c486d-7c6z8" event={"ID":"b8263992-6d6a-4e0d-b981-63ffe596c6eb","Type":"ContainerStarted","Data":"bfb82adf59e9f3add48d62b55e527fae4bf7b1b79d76a7a095916d4d66f027ae"} Jul 07 14:39:11.550561 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:11.550522 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kjct" event={"ID":"4d5b60d6-5b71-40cf-a0da-5f6d3fece667","Type":"ContainerStarted","Data":"7fee0b3515d81fc9909a587b19c1b4e6029a95a70cfb675e54bc26b3a4cc37e0"} Jul 07 14:39:11.664062 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:11.664000 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cbmr8" podUID="4dc76eb3-2ae2-4d44-bb57-55964b190580" Jul 07 14:39:12.559044 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:12.558981 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" event={"ID":"6bd1caf1-082b-43aa-95af-b63623077897","Type":"ContainerStarted","Data":"4a231cbd6583686a4b4e809b862d7b360e6eb5885a1f7e389de08c2c72c7921b"} Jul 07 14:39:12.560156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:12.560047 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:12.566096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:12.566052 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" Jul 07 14:39:12.575947 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:12.575896 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f7p6g" podStartSLOduration=2.059398488 podStartE2EDuration="3.575878377s" totalImagesPullingTime="1.516479889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:12.575043621 +0000 UTC m=+294.371150773" watchObservedRunningTime="2026-07-07 14:39:12.575878377 +0000 UTC m=+294.371985530" Jul 07 14:39:13.591007 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.590963 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf"] Jul 07 14:39:13.608123 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.608076 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf"] Jul 07 14:39:13.608315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.608205 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.612764 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.613005 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.613223 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6jz82\"" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.613409 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.613814 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:39:13.614061 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.613913 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:39:13.658971 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.658930 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.659122 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.658986 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.659159 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.659138 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f383002f-16cd-4743-b081-f6f1f98c5131-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.659217 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.659198 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5h5\" (UniqueName: \"kubernetes.io/projected/f383002f-16cd-4743-b081-f6f1f98c5131-kube-api-access-qw5h5\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.760841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.760555 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.760841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.760612 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.760841 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:13.760747 2590 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 14:39:13.760841 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:13.760812 2590 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls podName:f383002f-16cd-4743-b081-f6f1f98c5131 nodeName:}" failed. No retries permitted until 2026-07-07 14:39:14.260792585 +0000 UTC m=+296.056899727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-8d9pf" (UID: "f383002f-16cd-4743-b081-f6f1f98c5131") : secret "prometheus-operator-tls" not found Jul 07 14:39:13.761228 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.760853 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f383002f-16cd-4743-b081-f6f1f98c5131-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.761228 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.760906 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5h5\" (UniqueName: \"kubernetes.io/projected/f383002f-16cd-4743-b081-f6f1f98c5131-kube-api-access-qw5h5\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.761784 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.761748 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f383002f-16cd-4743-b081-f6f1f98c5131-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.764142 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.763534 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:13.772385 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:13.772318 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5h5\" (UniqueName: \"kubernetes.io/projected/f383002f-16cd-4743-b081-f6f1f98c5131-kube-api-access-qw5h5\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:14.266424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:14.266382 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:14.268981 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:14.268955 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f383002f-16cd-4743-b081-f6f1f98c5131-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-8d9pf\" (UID: \"f383002f-16cd-4743-b081-f6f1f98c5131\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:14.524798 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:14.524702 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" Jul 07 14:39:15.520085 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:15.520058 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p8prz" Jul 07 14:39:23.101364 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.101329 2590 patch_prober.go:28] interesting pod/image-registry-67cdf6fcf9-bsz8x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:39:23.103874 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.101382 2590 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:39:23.428211 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.428178 2590 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:39:23.496245 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.496146 2590 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:39:23.550492 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.550452 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf"] Jul 07 14:39:23.553452 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:23.553406 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf383002f_16cd_4743_b081_f6f1f98c5131.slice/crio-855a9293504ff8f303bdcf6d10b333ff439dc7412a37e158e2c0bdcc83ca23b9 WatchSource:0}: Error finding container 855a9293504ff8f303bdcf6d10b333ff439dc7412a37e158e2c0bdcc83ca23b9: Status 404 returned error can't find the container with id 855a9293504ff8f303bdcf6d10b333ff439dc7412a37e158e2c0bdcc83ca23b9 Jul 07 14:39:23.603285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.603249 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-nnb5d" event={"ID":"81b6b607-d3d4-42b8-9c45-328dacccd584","Type":"ContainerStarted","Data":"78091fa768f6753a90bc3bc4a06c3fdfe1476fc82854618f681bd519129a6682"} Jul 07 14:39:23.603463 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.603442 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:23.605133 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.605104 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757b9c486d-7c6z8" event={"ID":"b8263992-6d6a-4e0d-b981-63ffe596c6eb","Type":"ContainerStarted","Data":"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f"} Jul 07 14:39:23.605363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.605340 2590 patch_prober.go:28] interesting pod/downloads-685bfb5f64-nnb5d container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" start-of-body= Jul 07 14:39:23.605466 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.605388 2590 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-nnb5d" podUID="81b6b607-d3d4-42b8-9c45-328dacccd584" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" Jul 07 14:39:23.606792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.606766 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kjct" event={"ID":"4d5b60d6-5b71-40cf-a0da-5f6d3fece667","Type":"ContainerStarted","Data":"3ecac6158cc2007928b16b6de9fd2b25918a8f73057189953d9a1b671017a5da"} Jul 07 14:39:23.607964 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.607942 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" event={"ID":"f383002f-16cd-4743-b081-f6f1f98c5131","Type":"ContainerStarted","Data":"855a9293504ff8f303bdcf6d10b333ff439dc7412a37e158e2c0bdcc83ca23b9"} Jul 07 14:39:23.619454 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.619389 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-nnb5d" podStartSLOduration=1.320020663 podStartE2EDuration="20.619371195s" totalImagesPullingTime="19.299350532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:23.61872635 +0000 UTC m=+305.414833499" watchObservedRunningTime="2026-07-07 14:39:23.619371195 +0000 UTC m=+305.415478345" Jul 07 14:39:23.637237 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:23.637187 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-757b9c486d-7c6z8" podStartSLOduration=1.509172796 podStartE2EDuration="13.637168559s" totalImagesPullingTime="12.127995763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:23.635821374 +0000 UTC m=+305.431928526" watchObservedRunningTime="2026-07-07 14:39:23.637168559 +0000 UTC m=+305.433275708" Jul 07 14:39:24.616592 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:24.616495 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kjct" event={"ID":"4d5b60d6-5b71-40cf-a0da-5f6d3fece667","Type":"ContainerStarted","Data":"e231eab7eb9e04ade20ff1ae04d39b687128cb9ef14c025291db70468cd0af6a"} Jul 07 14:39:24.620252 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:24.620203 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-nnb5d" Jul 07 14:39:25.521929 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.521852 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:25.624557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.624505 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" event={"ID":"f383002f-16cd-4743-b081-f6f1f98c5131","Type":"ContainerStarted","Data":"8b3ec0a72a94994395ee74ec9ba44233435123313123048b9ab16eb897b822dc"} Jul 07 14:39:25.625152 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.625112 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" event={"ID":"f383002f-16cd-4743-b081-f6f1f98c5131","Type":"ContainerStarted","Data":"2470055ce3d0ec1d6ee4c05b79b2abd5c36c353dccfa92ccc804e9339818922e"} Jul 07 14:39:25.659501 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.659449 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:39:25.704676 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.704547 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-8d9pf" podStartSLOduration=11.096418915 podStartE2EDuration="12.704522686s" totalImagesPullingTime="1.608103771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:25.648339055 +0000 UTC m=+307.444446216" watchObservedRunningTime="2026-07-07 14:39:25.704522686 +0000 UTC m=+307.500629836" Jul 07 14:39:25.707323 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:25.707291 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:39:27.960565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.960533 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4bmnv"] Jul 07 14:39:27.981008 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.980976 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:27.984471 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.984447 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:39:27.984783 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.984760 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2kmmz\"" Jul 07 14:39:27.985798 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.985772 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:39:27.986054 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:27.986025 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:39:28.095756 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095717 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-metrics-client-ca\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.095908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095765 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-textfile\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.095908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095837 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.095908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095877 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-wtmp\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.095908 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095895 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndgg\" (UniqueName: \"kubernetes.io/projected/df9be8cf-9a18-44ce-89c5-338c0dbb0005-kube-api-access-6ndgg\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.096120 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.095915 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-sys\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.096120 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.096021 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.096120 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.096115 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-root\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.096236 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.096157 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-tls\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196745 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196711 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-root\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196769 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-tls\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196804 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-metrics-client-ca\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196830 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-textfile\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196834 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-root\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196858 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.196901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.196889 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-wtmp\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197217 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197039 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-wtmp\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197324 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndgg\" (UniqueName: \"kubernetes.io/projected/df9be8cf-9a18-44ce-89c5-338c0dbb0005-kube-api-access-6ndgg\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197374 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-sys\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197428 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197474 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-metrics-client-ca\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197328 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-textfile\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197543 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df9be8cf-9a18-44ce-89c5-338c0dbb0005-sys\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.197859 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.197817 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-accelerators-collector-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.200111 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.200086 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-tls\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.200611 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.200591 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df9be8cf-9a18-44ce-89c5-338c0dbb0005-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.209310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.209280 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndgg\" (UniqueName: \"kubernetes.io/projected/df9be8cf-9a18-44ce-89c5-338c0dbb0005-kube-api-access-6ndgg\") pod \"node-exporter-4bmnv\" (UID: \"df9be8cf-9a18-44ce-89c5-338c0dbb0005\") " pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.291973 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.291941 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4bmnv" Jul 07 14:39:28.323712 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:28.323676 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9be8cf_9a18_44ce_89c5_338c0dbb0005.slice/crio-65f0df46cbab97725f6c882027148673f0487f839e7c48eb65369f2fa9fcb06a WatchSource:0}: Error finding container 65f0df46cbab97725f6c882027148673f0487f839e7c48eb65369f2fa9fcb06a: Status 404 returned error can't find the container with id 65f0df46cbab97725f6c882027148673f0487f839e7c48eb65369f2fa9fcb06a Jul 07 14:39:28.640817 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.640413 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kjct" event={"ID":"4d5b60d6-5b71-40cf-a0da-5f6d3fece667","Type":"ContainerStarted","Data":"cdd3b4451b5d909ed23073f0ac70faac14de1fd77e6ea3181764ad3261f67837"} Jul 07 14:39:28.642960 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.642930 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bmnv" event={"ID":"df9be8cf-9a18-44ce-89c5-338c0dbb0005","Type":"ContainerStarted","Data":"65f0df46cbab97725f6c882027148673f0487f839e7c48eb65369f2fa9fcb06a"} Jul 07 14:39:28.657890 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:28.657845 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4kjct" podStartSLOduration=33.312237211 podStartE2EDuration="50.657827976s" totalImagesPullingTime="17.345590765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:38:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:28.657302811 +0000 UTC m=+310.453409992" watchObservedRunningTime="2026-07-07 14:39:28.657827976 +0000 UTC m=+310.453935128" Jul 07 14:39:30.117988 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.117954 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:30.653819 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.653777 2590 generic.go:356] "Generic (PLEG): container finished" podID="df9be8cf-9a18-44ce-89c5-338c0dbb0005" containerID="be7e18f1db4b2ba535bfceddf0e8dd597bc02172aa2a2ea0501b64b2edba25e0" exitCode=0 Jul 07 14:39:30.654097 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.653868 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bmnv" event={"ID":"df9be8cf-9a18-44ce-89c5-338c0dbb0005","Type":"ContainerDied","Data":"be7e18f1db4b2ba535bfceddf0e8dd597bc02172aa2a2ea0501b64b2edba25e0"} Jul 07 14:39:30.928918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.928892 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr"] Jul 07 14:39:30.952011 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.951973 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:30.953146 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.953078 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr"] Jul 07 14:39:30.955078 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.954928 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 14:39:30.956204 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.955912 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wqt6j\"" Jul 07 14:39:30.957384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.956680 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 14:39:30.957384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.956995 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 14:39:30.957384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.957018 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-atckap1fq21ci\"" Jul 07 14:39:30.957384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.957187 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 14:39:30.957384 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:30.957231 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 14:39:31.023373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023337 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9fz\" (UniqueName: \"kubernetes.io/projected/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-kube-api-access-zp9fz\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023390 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-grpc-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023423 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023475 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023510 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-metrics-client-ca\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023540 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023564 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.023632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.023598 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.080573 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.080534 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:31.124995 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.124955 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-metrics-client-ca\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125003 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125029 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125216 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125334 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9fz\" (UniqueName: \"kubernetes.io/projected/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-kube-api-access-zp9fz\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125382 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-grpc-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125415 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.125484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.125465 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.126410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.126383 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-metrics-client-ca\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.128611 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.128393 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.128611 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.128522 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.128611 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.128572 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.129081 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.129058 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-grpc-tls\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.129285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.129266 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.129533 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.129507 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.134410 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.134386 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9fz\" (UniqueName: \"kubernetes.io/projected/e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b-kube-api-access-zp9fz\") pod \"thanos-querier-cdc6cbc4d-89wzr\" (UID: \"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b\") " pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.265938 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.265839 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:31.460745 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.460709 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr"] Jul 07 14:39:31.464420 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:31.464386 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e3d4af_fa4b_4f84_8b0a_1dab97a7702b.slice/crio-50e78271bd4416f567688cfe33f4db7a60323db73c0fd30ccaffdce7344cf332 WatchSource:0}: Error finding container 50e78271bd4416f567688cfe33f4db7a60323db73c0fd30ccaffdce7344cf332: Status 404 returned error can't find the container with id 50e78271bd4416f567688cfe33f4db7a60323db73c0fd30ccaffdce7344cf332 Jul 07 14:39:31.660238 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.660192 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"50e78271bd4416f567688cfe33f4db7a60323db73c0fd30ccaffdce7344cf332"} Jul 07 14:39:31.662972 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.662928 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bmnv" event={"ID":"df9be8cf-9a18-44ce-89c5-338c0dbb0005","Type":"ContainerStarted","Data":"b5307da2f97c3ff1a3107c8df4f7be33d5a518c123c8bc3401b2873730a4edfb"} Jul 07 14:39:31.663159 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.662997 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4bmnv" event={"ID":"df9be8cf-9a18-44ce-89c5-338c0dbb0005","Type":"ContainerStarted","Data":"ae40efed65f7449488efb5c5256663b7d06c5985b2bb687dd8c26e67f5dcb8d9"} Jul 07 14:39:31.685231 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:31.685174 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4bmnv" podStartSLOduration=2.928139258 podStartE2EDuration="4.685156035s" totalImagesPullingTime="1.653065438s" totalInitContainerRuntime="103.951339ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:31.683902815 +0000 UTC m=+313.480009967" watchObservedRunningTime="2026-07-07 14:39:31.685156035 +0000 UTC m=+313.481263206" Jul 07 14:39:32.252667 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.252613 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84fd77d844-jgxc8"] Jul 07 14:39:32.280926 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.280896 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84fd77d844-jgxc8"] Jul 07 14:39:32.281103 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.281015 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.284146 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.284119 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 14:39:32.284632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.284436 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 14:39:32.286244 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.285312 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:39:32.286244 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.285543 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fdm32i7m6r2bt\"" Jul 07 14:39:32.286244 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.285565 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 14:39:32.286244 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.285742 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c4mvz\"" Jul 07 14:39:32.444349 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444313 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444349 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444358 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-client-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444442 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-client-certs\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444494 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-audit-log\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444557 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-tls\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444587 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-metrics-server-audit-profiles\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.444615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.444613 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72tl\" (UniqueName: \"kubernetes.io/projected/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-kube-api-access-f72tl\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546116 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546029 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546116 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546087 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-client-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546600 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546440 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-client-certs\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546600 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546511 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-audit-log\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546600 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546583 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-tls\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546973 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546617 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-metrics-server-audit-profiles\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.546973 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.546640 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f72tl\" (UniqueName: \"kubernetes.io/projected/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-kube-api-access-f72tl\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.547074 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.547006 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-audit-log\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.547507 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.547451 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.547952 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.547895 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-metrics-server-audit-profiles\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.550298 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.550259 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-client-certs\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.550704 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.550678 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-client-ca-bundle\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.552054 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.551980 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-secret-metrics-server-tls\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.555762 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.555717 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72tl\" (UniqueName: \"kubernetes.io/projected/fff1dcbe-b9d1-4414-9220-a5ac2690ecc1-kube-api-access-f72tl\") pod \"metrics-server-84fd77d844-jgxc8\" (UID: \"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1\") " pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.595989 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.595951 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:32.769832 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.769795 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr"] Jul 07 14:39:32.801760 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:32.801730 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff1dcbe_b9d1_4414_9220_a5ac2690ecc1.slice/crio-e51464af38bb1c3930ec132dc8ffb0bc7152c11ce64ab5d7005dbda201a05b35 WatchSource:0}: Error finding container e51464af38bb1c3930ec132dc8ffb0bc7152c11ce64ab5d7005dbda201a05b35: Status 404 returned error can't find the container with id e51464af38bb1c3930ec132dc8ffb0bc7152c11ce64ab5d7005dbda201a05b35 Jul 07 14:39:32.808595 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.808245 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:39:32.808595 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.808437 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:32.812493 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.812467 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 14:39:32.812801 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.812778 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bskl2\"" Jul 07 14:39:32.835403 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.835255 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr"] Jul 07 14:39:32.835403 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.835302 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:39:32.835403 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.835323 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84fd77d844-jgxc8"] Jul 07 14:39:32.835674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.835428 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.843719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.843308 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:39:32.950674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950621 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fgw\" (UniqueName: \"kubernetes.io/projected/de18ace7-77cc-4dee-a02b-b306e25fc202-kube-api-access-84fgw\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:32.950850 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950705 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.950850 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950749 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.950850 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950812 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46m8\" (UniqueName: \"kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.950850 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950836 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de18ace7-77cc-4dee-a02b-b306e25fc202-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:32.951060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950898 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.951060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950918 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.951060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950945 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:32.951060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:32.950980 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052137 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052051 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46m8\" (UniqueName: \"kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052137 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052096 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de18ace7-77cc-4dee-a02b-b306e25fc202-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:33.052363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052165 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052187 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052219 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052243 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052576 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052389 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fgw\" (UniqueName: \"kubernetes.io/projected/de18ace7-77cc-4dee-a02b-b306e25fc202-kube-api-access-84fgw\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:33.052576 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052448 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.052576 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.052502 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.053101 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.053028 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.053237 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.053134 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.053305 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.053252 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.053494 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.053455 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.054990 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.054970 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.055315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.055290 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de18ace7-77cc-4dee-a02b-b306e25fc202-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:33.055397 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.055316 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.061416 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.061393 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fgw\" (UniqueName: \"kubernetes.io/projected/de18ace7-77cc-4dee-a02b-b306e25fc202-kube-api-access-84fgw\") pod \"monitoring-plugin-d5dcff7cf-rhndr\" (UID: \"de18ace7-77cc-4dee-a02b-b306e25fc202\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:33.061523 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.061420 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46m8\" (UniqueName: \"kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8\") pod \"console-7bb88bbdc4-dgx75\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.122330 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.122295 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:33.147791 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.147751 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:33.672510 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.672463 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" event={"ID":"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1","Type":"ContainerStarted","Data":"e51464af38bb1c3930ec132dc8ffb0bc7152c11ce64ab5d7005dbda201a05b35"} Jul 07 14:39:33.892237 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.892176 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr"] Jul 07 14:39:33.894478 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:33.894439 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde18ace7_77cc_4dee_a02b_b306e25fc202.slice/crio-297c133517f4f4f880722983020562a95b82f1b77e7684230647c420fe19bd48 WatchSource:0}: Error finding container 297c133517f4f4f880722983020562a95b82f1b77e7684230647c420fe19bd48: Status 404 returned error can't find the container with id 297c133517f4f4f880722983020562a95b82f1b77e7684230647c420fe19bd48 Jul 07 14:39:33.907886 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:33.907776 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:39:33.910709 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:39:33.910677 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569842f8_6f2e_4b7f_ba60_1e89ccef1bae.slice/crio-c7c8bc63192e048b38ce118087d4c495c6e5c2a79b59a79b204b8960a1ce23be WatchSource:0}: Error finding container c7c8bc63192e048b38ce118087d4c495c6e5c2a79b59a79b204b8960a1ce23be: Status 404 returned error can't find the container with id c7c8bc63192e048b38ce118087d4c495c6e5c2a79b59a79b204b8960a1ce23be Jul 07 14:39:34.679076 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.679025 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" event={"ID":"de18ace7-77cc-4dee-a02b-b306e25fc202","Type":"ContainerStarted","Data":"297c133517f4f4f880722983020562a95b82f1b77e7684230647c420fe19bd48"} Jul 07 14:39:34.681789 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.681749 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"d23e8a9edc737b052f7441b47763b9426b6c1eab662f6f559faaa726125b4bc1"} Jul 07 14:39:34.681916 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.681831 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"61bec166f7c71e44cf16d949f1e877135b40d7b84efc454f4f5f95895e457e39"} Jul 07 14:39:34.681916 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.681876 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"909712724f75bbea91d57a0e9176b9e75d8ed40df3a2bed0f464d181c00858b5"} Jul 07 14:39:34.683589 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.683558 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb88bbdc4-dgx75" event={"ID":"569842f8-6f2e-4b7f-ba60-1e89ccef1bae","Type":"ContainerStarted","Data":"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72"} Jul 07 14:39:34.683589 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.683610 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb88bbdc4-dgx75" event={"ID":"569842f8-6f2e-4b7f-ba60-1e89ccef1bae","Type":"ContainerStarted","Data":"c7c8bc63192e048b38ce118087d4c495c6e5c2a79b59a79b204b8960a1ce23be"} Jul 07 14:39:34.704025 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:34.703805 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb88bbdc4-dgx75" podStartSLOduration=2.703783303 podStartE2EDuration="2.703783303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:34.701990476 +0000 UTC m=+316.498097627" watchObservedRunningTime="2026-07-07 14:39:34.703783303 +0000 UTC m=+316.499890454" Jul 07 14:39:36.693000 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:36.692967 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" event={"ID":"de18ace7-77cc-4dee-a02b-b306e25fc202","Type":"ContainerStarted","Data":"1cf501be4563dc54d45bca3a8d225e9e429c4c4cdf457b6057cca5b425e3579a"} Jul 07 14:39:36.693505 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:36.693160 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:36.694703 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:36.694671 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" event={"ID":"fff1dcbe-b9d1-4414-9220-a5ac2690ecc1","Type":"ContainerStarted","Data":"528d3a0678d5b12c7bd3c50a219a6b214d8fb3211bf5a91701cf655f8655362a"} Jul 07 14:39:36.698431 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:36.698404 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" Jul 07 14:39:36.709348 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:36.709296 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rhndr" podStartSLOduration=2.264079291 podStartE2EDuration="4.709276593s" totalImagesPullingTime="2.445197302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:36.708267002 +0000 UTC m=+318.504374151" watchObservedRunningTime="2026-07-07 14:39:36.709276593 +0000 UTC m=+318.505383745" Jul 07 14:39:37.705784 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:37.705743 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"e5c9f2d21c31a2425f48a369e819059d78de3ea37fbf6f28eb160098abb9c992"} Jul 07 14:39:37.706229 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:37.705843 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"9d8077272fc780ad2065a110620a026d2a5295291ad4de4364fb1604746cf4f2"} Jul 07 14:39:37.706229 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:37.705877 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" event={"ID":"e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b","Type":"ContainerStarted","Data":"9c639486eddedcb95efc866a6172e3c0501a34c542753191e1a755f84e0540bf"} Jul 07 14:39:37.727876 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:37.727815 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" podStartSLOduration=2.906836358 podStartE2EDuration="7.727794392s" totalImagesPullingTime="4.820958034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:37.725909783 +0000 UTC m=+319.522016934" watchObservedRunningTime="2026-07-07 14:39:37.727794392 +0000 UTC m=+319.523901546" Jul 07 14:39:37.728979 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:37.728932 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" podStartSLOduration=2.192517434 podStartE2EDuration="5.728920032s" totalImagesPullingTime="3.536402598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:36.739148069 +0000 UTC m=+318.535255220" watchObservedRunningTime="2026-07-07 14:39:37.728920032 +0000 UTC m=+319.525027189" Jul 07 14:39:38.709719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:38.709684 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:39.719831 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:39.719802 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cdc6cbc4d-89wzr" Jul 07 14:39:42.728661 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:42.728622 2590 generic.go:356] "Generic (PLEG): container finished" podID="58dd583e-e59a-4ea7-8a11-4ded2195a28e" containerID="f134928bdf275d84c2b34a9cafdbd9b76fdf04e41bc620c0509cfbe69cbb0c9a" exitCode=0 Jul 07 14:39:42.729054 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:42.728700 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" event={"ID":"58dd583e-e59a-4ea7-8a11-4ded2195a28e","Type":"ContainerDied","Data":"f134928bdf275d84c2b34a9cafdbd9b76fdf04e41bc620c0509cfbe69cbb0c9a"} Jul 07 14:39:42.729054 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:42.729015 2590 scope.go:117] "RemoveContainer" containerID="f134928bdf275d84c2b34a9cafdbd9b76fdf04e41bc620c0509cfbe69cbb0c9a" Jul 07 14:39:43.148265 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:43.148229 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:43.148487 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:43.148301 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:43.153174 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:43.153150 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:43.737077 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:43.737037 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7bw74" event={"ID":"58dd583e-e59a-4ea7-8a11-4ded2195a28e","Type":"ContainerStarted","Data":"ca76d560b32f9d75bd80d9c9941ef9564a015206713c911ccaaf7e819ccca06a"} Jul 07 14:39:43.740981 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:43.740959 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:39:50.739225 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:50.739155 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerName="registry" containerID="cri-o://9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b" gracePeriod=30 Jul 07 14:39:51.015769 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.015713 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:51.114264 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114232 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114274 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114322 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdkc7\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114348 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114379 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114402 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114449 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114449 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114835 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114476 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets\") pod \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\" (UID: \"2373444e-c9ce-4aba-9f09-ef1a7886cf63\") " Jul 07 14:39:51.114892 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114856 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:51.114946 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.114928 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:51.116989 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.116938 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:51.117132 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.117111 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:51.117203 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.117185 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7" (OuterVolumeSpecName: "kube-api-access-vdkc7") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "kube-api-access-vdkc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:51.117256 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.117190 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:51.117312 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.117296 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:51.123192 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.123169 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2373444e-c9ce-4aba-9f09-ef1a7886cf63" (UID: "2373444e-c9ce-4aba-9f09-ef1a7886cf63"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:39:51.215332 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215290 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdkc7\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-kube-api-access-vdkc7\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215332 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215323 2590 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-image-registry-private-configuration\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215332 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215335 2590 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-bound-sa-token\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215332 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215343 2590 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-tls\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215584 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215352 2590 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-registry-certificates\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215584 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215361 2590 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2373444e-c9ce-4aba-9f09-ef1a7886cf63-installation-pull-secrets\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215584 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215369 2590 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2373444e-c9ce-4aba-9f09-ef1a7886cf63-ca-trust-extracted\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.215584 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.215378 2590 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2373444e-c9ce-4aba-9f09-ef1a7886cf63-trusted-ca\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:51.770185 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.770150 2590 generic.go:356] "Generic (PLEG): container finished" podID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerID="9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b" exitCode=0 Jul 07 14:39:51.770679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.770201 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" Jul 07 14:39:51.770679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.770206 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" event={"ID":"2373444e-c9ce-4aba-9f09-ef1a7886cf63","Type":"ContainerDied","Data":"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b"} Jul 07 14:39:51.770679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.770246 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67cdf6fcf9-bsz8x" event={"ID":"2373444e-c9ce-4aba-9f09-ef1a7886cf63","Type":"ContainerDied","Data":"2cf46dfe88d3d424cc1c7862a6912ad2796cfd8d4006701cede9bc6e1490b387"} Jul 07 14:39:51.770679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.770266 2590 scope.go:117] "RemoveContainer" containerID="9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b" Jul 07 14:39:51.779391 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.779374 2590 scope.go:117] "RemoveContainer" containerID="9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b" Jul 07 14:39:51.779692 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:51.779665 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b\": container with ID starting with 9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b not found: ID does not exist" containerID="9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b" Jul 07 14:39:51.779746 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.779703 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b"} err="failed to get container status \"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b\": rpc error: code = NotFound desc = could not find container \"9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b\": container with ID starting with 9ee7939a12ddb797c244ef867ebf7af5f41236c2511d3392f7de065b080e618b not found: ID does not exist" Jul 07 14:39:51.790851 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.790828 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:39:51.794729 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:51.794709 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67cdf6fcf9-bsz8x"] Jul 07 14:39:52.597045 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:52.597007 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:52.597227 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:52.597097 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:39:52.665046 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:52.665011 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" path="/var/lib/kubelet/pods/2373444e-c9ce-4aba-9f09-ef1a7886cf63/volumes" Jul 07 14:39:55.141976 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.141938 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-757b9c486d-7c6z8" podUID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" containerName="console" containerID="cri-o://5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f" gracePeriod=15 Jul 07 14:39:55.462477 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.462395 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554456 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554526 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554562 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554603 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554694 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.554728 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm76x\" (UniqueName: \"kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x\") pod \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\" (UID: \"b8263992-6d6a-4e0d-b981-63ffe596c6eb\") " Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.555670 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.556334 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config" (OuterVolumeSpecName: "console-config") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:55.558674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.556726 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:55.568669 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.560674 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:55.568669 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.566756 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x" (OuterVolumeSpecName: "kube-api-access-vm76x") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "kube-api-access-vm76x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:55.568669 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.568311 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8263992-6d6a-4e0d-b981-63ffe596c6eb" (UID: "b8263992-6d6a-4e0d-b981-63ffe596c6eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:55.655525 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655492 2590 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.655525 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655524 2590 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.655525 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655534 2590 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-service-ca\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.655752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655542 2590 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8263992-6d6a-4e0d-b981-63ffe596c6eb-console-oauth-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.655752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655551 2590 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8263992-6d6a-4e0d-b981-63ffe596c6eb-oauth-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.655752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.655560 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm76x\" (UniqueName: \"kubernetes.io/projected/b8263992-6d6a-4e0d-b981-63ffe596c6eb-kube-api-access-vm76x\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:39:55.788847 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.788757 2590 generic.go:356] "Generic (PLEG): container finished" podID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" containerID="5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f" exitCode=0 Jul 07 14:39:55.788847 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.788810 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-757b9c486d-7c6z8" Jul 07 14:39:55.789033 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.788814 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757b9c486d-7c6z8" event={"ID":"b8263992-6d6a-4e0d-b981-63ffe596c6eb","Type":"ContainerDied","Data":"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f"} Jul 07 14:39:55.789033 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.788933 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-757b9c486d-7c6z8" event={"ID":"b8263992-6d6a-4e0d-b981-63ffe596c6eb","Type":"ContainerDied","Data":"bfb82adf59e9f3add48d62b55e527fae4bf7b1b79d76a7a095916d4d66f027ae"} Jul 07 14:39:55.789033 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.788954 2590 scope.go:117] "RemoveContainer" containerID="5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f" Jul 07 14:39:55.798744 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.798718 2590 scope.go:117] "RemoveContainer" containerID="5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f" Jul 07 14:39:55.799012 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:39:55.798989 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f\": container with ID starting with 5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f not found: ID does not exist" containerID="5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f" Jul 07 14:39:55.799077 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.799020 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f"} err="failed to get container status \"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f\": rpc error: code = NotFound desc = could not find container \"5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f\": container with ID starting with 5f28d8a26c2d10f07a775e267973e15b647e16f9a8a05ebad8a5c9ffa3a14e6f not found: ID does not exist" Jul 07 14:39:55.810638 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.810610 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:55.814625 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:55.814593 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-757b9c486d-7c6z8"] Jul 07 14:39:56.665311 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:39:56.665278 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" path="/var/lib/kubelet/pods/b8263992-6d6a-4e0d-b981-63ffe596c6eb/volumes" Jul 07 14:40:12.601913 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:12.601881 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:40:12.606047 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:12.606022 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84fd77d844-jgxc8" Jul 07 14:40:32.658508 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:32.658473 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:40:32.660759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:32.660726 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dc76eb3-2ae2-4d44-bb57-55964b190580-metrics-certs\") pod \"network-metrics-daemon-cbmr8\" (UID: \"4dc76eb3-2ae2-4d44-bb57-55964b190580\") " pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:40:32.862766 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:32.862728 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v8hh9\"" Jul 07 14:40:32.870733 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:32.870703 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cbmr8" Jul 07 14:40:33.005676 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:33.005636 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cbmr8"] Jul 07 14:40:33.008342 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:40:33.008312 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc76eb3_2ae2_4d44_bb57_55964b190580.slice/crio-55b9acf60de368d9ff7e08a05876e4a0879441ef26f85c314d510c4084dc5721 WatchSource:0}: Error finding container 55b9acf60de368d9ff7e08a05876e4a0879441ef26f85c314d510c4084dc5721: Status 404 returned error can't find the container with id 55b9acf60de368d9ff7e08a05876e4a0879441ef26f85c314d510c4084dc5721 Jul 07 14:40:33.932694 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:33.932659 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmr8" event={"ID":"4dc76eb3-2ae2-4d44-bb57-55964b190580","Type":"ContainerStarted","Data":"55b9acf60de368d9ff7e08a05876e4a0879441ef26f85c314d510c4084dc5721"} Jul 07 14:40:34.938600 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:34.938565 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmr8" event={"ID":"4dc76eb3-2ae2-4d44-bb57-55964b190580","Type":"ContainerStarted","Data":"1fac8b4db137f0fc0a74af13fd2380a17f2469b3e9e88ad9c0b5399adbe7ba35"} Jul 07 14:40:34.939065 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:34.938616 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cbmr8" event={"ID":"4dc76eb3-2ae2-4d44-bb57-55964b190580","Type":"ContainerStarted","Data":"ef82259579cc27edc3a598f5c660f22c587f55b4806f4edf13f58b567875d2a9"} Jul 07 14:40:34.956502 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:34.956461 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cbmr8" podStartSLOduration=375.790183885 podStartE2EDuration="6m16.956443623s" totalImagesPullingTime="1.166259738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:34.954949244 +0000 UTC m=+376.751056397" watchObservedRunningTime="2026-07-07 14:40:34.956443623 +0000 UTC m=+376.752550773" Jul 07 14:40:50.482613 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.482578 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483031 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" containerName="console" Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483045 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" containerName="console" Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483054 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerName="registry" Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483067 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerName="registry" Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483123 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="2373444e-c9ce-4aba-9f09-ef1a7886cf63" containerName="registry" Jul 07 14:40:50.483226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.483134 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8263992-6d6a-4e0d-b981-63ffe596c6eb" containerName="console" Jul 07 14:40:50.488425 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.488399 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.491143 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491119 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 14:40:50.491286 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491255 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 14:40:50.491286 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491266 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 14:40:50.491468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491292 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 14:40:50.491468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491329 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 14:40:50.491468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491334 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 14:40:50.491468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491352 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ssm4h\"" Jul 07 14:40:50.491677 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491604 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 14:40:50.491746 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.491706 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 14:40:50.496480 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.496464 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 14:40:50.501111 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.501090 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:40:50.583827 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583790 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mcgw\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-kube-api-access-8mcgw\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.583827 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583828 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-out\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583845 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583867 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583937 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583968 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.583992 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584066 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584101 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584120 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584147 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-web-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584190 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.584346 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.584217 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.684969 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685014 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685037 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685076 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-web-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685108 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685141 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685161 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mcgw\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-kube-api-access-8mcgw\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685189 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-out\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685211 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685238 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685277 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685743 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685307 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685743 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685336 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.685863 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.685754 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.686172 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.686143 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.686767 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.686743 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688332 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-web-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688336 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-volume\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688413 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-config-out\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688489 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688547 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.688885 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688551 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.689296 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.688973 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.689296 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.689265 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.690407 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.690388 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.697176 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.697153 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mcgw\" (UniqueName: \"kubernetes.io/projected/96419f78-9ea6-4e78-8a52-01aee1ea2e2c-kube-api-access-8mcgw\") pod \"alertmanager-main-0\" (UID: \"96419f78-9ea6-4e78-8a52-01aee1ea2e2c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.798808 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.798721 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 14:40:50.944232 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.944144 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 14:40:50.947083 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:40:50.947060 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96419f78_9ea6_4e78_8a52_01aee1ea2e2c.slice/crio-3d0780cbab1b469eb86d153183be0690d988c64f1769f26ec21c002ee94a5c9f WatchSource:0}: Error finding container 3d0780cbab1b469eb86d153183be0690d988c64f1769f26ec21c002ee94a5c9f: Status 404 returned error can't find the container with id 3d0780cbab1b469eb86d153183be0690d988c64f1769f26ec21c002ee94a5c9f Jul 07 14:40:50.997873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:50.997838 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"3d0780cbab1b469eb86d153183be0690d988c64f1769f26ec21c002ee94a5c9f"} Jul 07 14:40:52.323025 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.322995 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg"] Jul 07 14:40:52.326852 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.326831 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.329614 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329454 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 14:40:52.329614 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329468 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 14:40:52.329614 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329481 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 14:40:52.329614 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329517 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lxqlp\"" Jul 07 14:40:52.329614 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329468 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 14:40:52.329959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.329943 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 14:40:52.342494 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.340798 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg"] Jul 07 14:40:52.343720 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.343695 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 14:40:52.399190 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399161 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-serving-certs-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399216 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399276 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-federate-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399309 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399474 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399331 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5gf\" (UniqueName: \"kubernetes.io/projected/e967e785-161d-43ab-a4fa-3f0534987b45-kube-api-access-vl5gf\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399474 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399358 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399474 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399388 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-metrics-client-ca\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.399474 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.399430 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.499920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.499883 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.499942 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-federate-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.499984 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.500019 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5gf\" (UniqueName: \"kubernetes.io/projected/e967e785-161d-43ab-a4fa-3f0534987b45-kube-api-access-vl5gf\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.500054 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.500078 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-metrics-client-ca\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.500106 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.500457 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.500155 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-serving-certs-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503378 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.501090 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-metrics-client-ca\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503378 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.501539 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-serving-certs-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503378 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.501623 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503378 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.502847 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503378 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.503239 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-telemeter-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.503742 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-federate-client-tls\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.503901 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.503880 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e967e785-161d-43ab-a4fa-3f0534987b45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.508746 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.508700 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5gf\" (UniqueName: \"kubernetes.io/projected/e967e785-161d-43ab-a4fa-3f0534987b45-kube-api-access-vl5gf\") pod \"telemeter-client-848c5cbcd4-kjtbg\" (UID: \"e967e785-161d-43ab-a4fa-3f0534987b45\") " pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.643619 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.643518 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" Jul 07 14:40:52.799677 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:52.799639 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg"] Jul 07 14:40:52.802372 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:40:52.802338 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode967e785_161d_43ab_a4fa_3f0534987b45.slice/crio-b177805526f1de67c9cc231e60aa948190add21679709d22afe31ae94192ac90 WatchSource:0}: Error finding container b177805526f1de67c9cc231e60aa948190add21679709d22afe31ae94192ac90: Status 404 returned error can't find the container with id b177805526f1de67c9cc231e60aa948190add21679709d22afe31ae94192ac90 Jul 07 14:40:53.007577 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:53.007544 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" event={"ID":"e967e785-161d-43ab-a4fa-3f0534987b45","Type":"ContainerStarted","Data":"b177805526f1de67c9cc231e60aa948190add21679709d22afe31ae94192ac90"} Jul 07 14:40:53.009167 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:53.009145 2590 generic.go:356] "Generic (PLEG): container finished" podID="96419f78-9ea6-4e78-8a52-01aee1ea2e2c" containerID="30cd4d111f20d357cd14c1c2dc840e6ac5be0f9d3cc5fc7ce2d01fed05e44248" exitCode=0 Jul 07 14:40:53.009261 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:53.009233 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerDied","Data":"30cd4d111f20d357cd14c1c2dc840e6ac5be0f9d3cc5fc7ce2d01fed05e44248"} Jul 07 14:40:56.022533 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.022494 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" event={"ID":"e967e785-161d-43ab-a4fa-3f0534987b45","Type":"ContainerStarted","Data":"ae30ee4ad14a022fc2f650aa1ebf897004dd08f4fc529f718214adf2c9f4c46b"} Jul 07 14:40:56.023101 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.022598 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" event={"ID":"e967e785-161d-43ab-a4fa-3f0534987b45","Type":"ContainerStarted","Data":"dc82517d2ea0d6c47f2b72c9a75ad2e6b13424bea817d0c2d1e195f38db6d2de"} Jul 07 14:40:56.023101 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.022635 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" event={"ID":"e967e785-161d-43ab-a4fa-3f0534987b45","Type":"ContainerStarted","Data":"1e989473b635c9206a4cd7da0d60a2689510a0dc012fe644fedcf0c7b8ce58be"} Jul 07 14:40:56.025790 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025765 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"72dadf9a46474adbf2c860fbe8f00f432208412b7c509185a8776a13dbdb9cc8"} Jul 07 14:40:56.025897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025816 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"25f441ea1a9c01b00b9e5bc3fc5f7e28a85cdbd2daf2cd5b449b10e9903fd3f6"} Jul 07 14:40:56.025897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025857 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"a9754385d2bce41c8b517cda20e9d154de532916e3de9133850d2e66e84d6885"} Jul 07 14:40:56.025897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025882 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"8e2e25817c74d41bfe7df8e249b561c244f3eaa0288ab9bc505da8368ac74d09"} Jul 07 14:40:56.026004 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025904 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"4397a767f2ab014e0e5d60e6fdb70bad54197405ea1751739a1f5a2bfd139c42"} Jul 07 14:40:56.026004 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.025925 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96419f78-9ea6-4e78-8a52-01aee1ea2e2c","Type":"ContainerStarted","Data":"0598c81c09c3338fd3b64713029d15d5e880ce90767cf387d7beeee3f41512f5"} Jul 07 14:40:56.046596 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.046533 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-848c5cbcd4-kjtbg" podStartSLOduration=1.846946134 podStartE2EDuration="4.046517454s" totalImagesPullingTime="2.19957132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:56.04468228 +0000 UTC m=+397.840789429" watchObservedRunningTime="2026-07-07 14:40:56.046517454 +0000 UTC m=+397.842624604" Jul 07 14:40:56.077334 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.077283 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.625474621 podStartE2EDuration="6.077266063s" totalImagesPullingTime="3.431773596s" totalInitContainerRuntime="20.017846ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:56.076272805 +0000 UTC m=+397.872379957" watchObservedRunningTime="2026-07-07 14:40:56.077266063 +0000 UTC m=+397.873373212" Jul 07 14:40:56.769990 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.769937 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:40:56.773780 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.773751 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.786512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.786479 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:40:56.841924 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.841891 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.841924 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.841931 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.842156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.841947 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.842156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.842014 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.842156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.842071 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.842156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.842115 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.842156 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.842135 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbq6g\" (UniqueName: \"kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942616 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942583 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942616 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942620 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbq6g\" (UniqueName: \"kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942845 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942693 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942845 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942714 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942845 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942812 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942993 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942866 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.942993 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.942905 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.943490 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.943460 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.943615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.943493 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.943615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.943568 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.943807 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.943788 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.945326 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.945298 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.945448 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.945431 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:56.952140 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:56.952119 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbq6g\" (UniqueName: \"kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g\") pod \"console-6d7c45b865-82xxr\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:57.085687 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:57.085561 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:40:57.224687 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:57.224658 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:40:57.227330 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:40:57.227303 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50466bd4_d325_40d7_9f33_e59786b120bd.slice/crio-2e66164139966855f43812c694825cfd6f0ea4319347eb847614722f621597de WatchSource:0}: Error finding container 2e66164139966855f43812c694825cfd6f0ea4319347eb847614722f621597de: Status 404 returned error can't find the container with id 2e66164139966855f43812c694825cfd6f0ea4319347eb847614722f621597de Jul 07 14:40:58.036395 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:58.036362 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7c45b865-82xxr" event={"ID":"50466bd4-d325-40d7-9f33-e59786b120bd","Type":"ContainerStarted","Data":"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8"} Jul 07 14:40:58.036595 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:58.036408 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7c45b865-82xxr" event={"ID":"50466bd4-d325-40d7-9f33-e59786b120bd","Type":"ContainerStarted","Data":"2e66164139966855f43812c694825cfd6f0ea4319347eb847614722f621597de"} Jul 07 14:40:58.055734 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:40:58.055687 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7c45b865-82xxr" podStartSLOduration=2.055670878 podStartE2EDuration="2.055670878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:58.054238357 +0000 UTC m=+399.850345507" watchObservedRunningTime="2026-07-07 14:40:58.055670878 +0000 UTC m=+399.851778055" Jul 07 14:41:07.086181 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:07.086143 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:41:07.086707 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:07.086201 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:41:07.090831 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:07.090809 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:41:08.084192 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:08.084163 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:41:08.132736 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:08.132702 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:41:33.156239 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.156195 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bb88bbdc4-dgx75" podUID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" containerName="console" containerID="cri-o://d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72" gracePeriod=15 Jul 07 14:41:33.409985 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.409926 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:41:33.556184 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556149 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556194 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46m8\" (UniqueName: \"kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556229 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556254 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556275 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556318 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556376 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556353 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert\") pod \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\" (UID: \"569842f8-6f2e-4b7f-ba60-1e89ccef1bae\") " Jul 07 14:41:33.556842 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556740 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca" (OuterVolumeSpecName: "service-ca") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:41:33.556842 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556753 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config" (OuterVolumeSpecName: "console-config") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:41:33.557036 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556853 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:41:33.557036 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.556983 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:41:33.558472 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.558450 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:41:33.558572 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.558447 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8" (OuterVolumeSpecName: "kube-api-access-s46m8") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "kube-api-access-s46m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:41:33.558572 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.558529 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "569842f8-6f2e-4b7f-ba60-1e89ccef1bae" (UID: "569842f8-6f2e-4b7f-ba60-1e89ccef1bae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:41:33.657838 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657809 2590 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-trusted-ca-bundle\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.657838 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657836 2590 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-oauth-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.657838 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657845 2590 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-oauth-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.658071 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657858 2590 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.658071 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657871 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46m8\" (UniqueName: \"kubernetes.io/projected/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-kube-api-access-s46m8\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.658071 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657882 2590 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-service-ca\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:33.658071 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:33.657890 2590 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/569842f8-6f2e-4b7f-ba60-1e89ccef1bae-console-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:41:34.191680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.188601 2590 generic.go:356] "Generic (PLEG): container finished" podID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" containerID="d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72" exitCode=0 Jul 07 14:41:34.191680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.188788 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb88bbdc4-dgx75" event={"ID":"569842f8-6f2e-4b7f-ba60-1e89ccef1bae","Type":"ContainerDied","Data":"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72"} Jul 07 14:41:34.191680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.188872 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb88bbdc4-dgx75" event={"ID":"569842f8-6f2e-4b7f-ba60-1e89ccef1bae","Type":"ContainerDied","Data":"c7c8bc63192e048b38ce118087d4c495c6e5c2a79b59a79b204b8960a1ce23be"} Jul 07 14:41:34.191680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.188912 2590 scope.go:117] "RemoveContainer" containerID="d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72" Jul 07 14:41:34.191680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.189135 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb88bbdc4-dgx75" Jul 07 14:41:34.202721 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.202633 2590 scope.go:117] "RemoveContainer" containerID="d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72" Jul 07 14:41:34.203022 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:41:34.203004 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72\": container with ID starting with d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72 not found: ID does not exist" containerID="d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72" Jul 07 14:41:34.203076 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.203032 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72"} err="failed to get container status \"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72\": rpc error: code = NotFound desc = could not find container \"d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72\": container with ID starting with d89ef7155abaff8b6acd789fefe45145ca26df3a0e5a1cd119c37745144b4e72 not found: ID does not exist" Jul 07 14:41:34.212663 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.212621 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:41:34.216386 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.216358 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb88bbdc4-dgx75"] Jul 07 14:41:34.665760 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:41:34.665730 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" path="/var/lib/kubelet/pods/569842f8-6f2e-4b7f-ba60-1e89ccef1bae/volumes" Jul 07 14:42:27.895511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.895475 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-667c5759f-5dwz7"] Jul 07 14:42:27.895970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.895813 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" containerName="console" Jul 07 14:42:27.895970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.895824 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" containerName="console" Jul 07 14:42:27.895970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.895883 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="569842f8-6f2e-4b7f-ba60-1e89ccef1bae" containerName="console" Jul 07 14:42:27.899944 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.899921 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:27.912206 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:27.912183 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667c5759f-5dwz7"] Jul 07 14:42:28.010972 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.010940 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-oauth-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.010972 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.010975 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.011189 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.011094 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-trusted-ca-bundle\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.011189 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.011130 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lpt\" (UniqueName: \"kubernetes.io/projected/8bfb42f1-759c-48e5-82a3-87e684cd56a6-kube-api-access-82lpt\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.011189 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.011149 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-oauth-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.011189 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.011174 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-service-ca\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.011309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.011222 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112101 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112071 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-trusted-ca-bundle\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112101 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112104 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lpt\" (UniqueName: \"kubernetes.io/projected/8bfb42f1-759c-48e5-82a3-87e684cd56a6-kube-api-access-82lpt\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112300 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112120 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-oauth-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112342 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112323 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-service-ca\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112430 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112412 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112495 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112467 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-oauth-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.112548 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.112494 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.113117 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.113088 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-service-ca\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.113117 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.113109 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-oauth-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.113271 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.113141 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-trusted-ca-bundle\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.113271 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.113197 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.114608 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.114589 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-oauth-config\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.114729 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.114712 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bfb42f1-759c-48e5-82a3-87e684cd56a6-console-serving-cert\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.122424 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.122406 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lpt\" (UniqueName: \"kubernetes.io/projected/8bfb42f1-759c-48e5-82a3-87e684cd56a6-kube-api-access-82lpt\") pod \"console-667c5759f-5dwz7\" (UID: \"8bfb42f1-759c-48e5-82a3-87e684cd56a6\") " pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.208828 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.208794 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:28.367256 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.367229 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-667c5759f-5dwz7"] Jul 07 14:42:28.369427 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:42:28.369400 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfb42f1_759c_48e5_82a3_87e684cd56a6.slice/crio-cb7e8d4f8a60a9d69dcdd1364cf412e092c8494c1535dcd11e5db8479941cbd5 WatchSource:0}: Error finding container cb7e8d4f8a60a9d69dcdd1364cf412e092c8494c1535dcd11e5db8479941cbd5: Status 404 returned error can't find the container with id cb7e8d4f8a60a9d69dcdd1364cf412e092c8494c1535dcd11e5db8479941cbd5 Jul 07 14:42:28.411412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:28.411385 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667c5759f-5dwz7" event={"ID":"8bfb42f1-759c-48e5-82a3-87e684cd56a6","Type":"ContainerStarted","Data":"cb7e8d4f8a60a9d69dcdd1364cf412e092c8494c1535dcd11e5db8479941cbd5"} Jul 07 14:42:29.416747 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:29.416713 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-667c5759f-5dwz7" event={"ID":"8bfb42f1-759c-48e5-82a3-87e684cd56a6","Type":"ContainerStarted","Data":"190cbed40b0c7d2a1792e0010898685193af83faee46d7cb8e6ec08fa16721a8"} Jul 07 14:42:29.439167 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:29.439109 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-667c5759f-5dwz7" podStartSLOduration=2.4390896890000002 podStartE2EDuration="2.439089689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:42:29.438247059 +0000 UTC m=+491.234354200" watchObservedRunningTime="2026-07-07 14:42:29.439089689 +0000 UTC m=+491.235196839" Jul 07 14:42:38.209132 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:38.209058 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:38.209558 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:38.209173 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:38.214345 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:38.214317 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:38.455713 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:38.455686 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-667c5759f-5dwz7" Jul 07 14:42:38.501869 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:42:38.501782 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:43:03.522468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.522403 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d7c45b865-82xxr" podUID="50466bd4-d325-40d7-9f33-e59786b120bd" containerName="console" containerID="cri-o://23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8" gracePeriod=15 Jul 07 14:43:03.771329 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.771303 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:43:03.927312 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927282 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927312 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927317 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927339 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927365 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927392 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbq6g\" (UniqueName: \"kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927464 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927487 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert\") pod \"50466bd4-d325-40d7-9f33-e59786b120bd\" (UID: \"50466bd4-d325-40d7-9f33-e59786b120bd\") " Jul 07 14:43:03.927841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927734 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config" (OuterVolumeSpecName: "console-config") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:43:03.927841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.927779 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:43:03.928030 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.928011 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:43:03.928030 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.928019 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:43:03.929528 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.929505 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g" (OuterVolumeSpecName: "kube-api-access-dbq6g") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "kube-api-access-dbq6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:43:03.929970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.929947 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:43:03.929970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:03.929965 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50466bd4-d325-40d7-9f33-e59786b120bd" (UID: "50466bd4-d325-40d7-9f33-e59786b120bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:43:04.029010 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.028968 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbq6g\" (UniqueName: \"kubernetes.io/projected/50466bd4-d325-40d7-9f33-e59786b120bd-kube-api-access-dbq6g\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029010 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029003 2590 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029010 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029015 2590 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-oauth-serving-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029250 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029027 2590 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-service-ca\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029250 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029039 2590 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-console-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029250 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029050 2590 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50466bd4-d325-40d7-9f33-e59786b120bd-trusted-ca-bundle\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.029250 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.029060 2590 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50466bd4-d325-40d7-9f33-e59786b120bd-console-oauth-config\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:43:04.556870 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.556840 2590 generic.go:356] "Generic (PLEG): container finished" podID="50466bd4-d325-40d7-9f33-e59786b120bd" containerID="23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8" exitCode=0 Jul 07 14:43:04.557307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.556884 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7c45b865-82xxr" Jul 07 14:43:04.557307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.556927 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7c45b865-82xxr" event={"ID":"50466bd4-d325-40d7-9f33-e59786b120bd","Type":"ContainerDied","Data":"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8"} Jul 07 14:43:04.557307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.556984 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7c45b865-82xxr" event={"ID":"50466bd4-d325-40d7-9f33-e59786b120bd","Type":"ContainerDied","Data":"2e66164139966855f43812c694825cfd6f0ea4319347eb847614722f621597de"} Jul 07 14:43:04.557307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.557011 2590 scope.go:117] "RemoveContainer" containerID="23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8" Jul 07 14:43:04.565732 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.565711 2590 scope.go:117] "RemoveContainer" containerID="23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8" Jul 07 14:43:04.565979 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:43:04.565961 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8\": container with ID starting with 23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8 not found: ID does not exist" containerID="23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8" Jul 07 14:43:04.566036 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.565992 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8"} err="failed to get container status \"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8\": rpc error: code = NotFound desc = could not find container \"23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8\": container with ID starting with 23e80c1662125bd39dcdf39ce3e95d569d0b50d22edefbf47691c1965641efa8 not found: ID does not exist" Jul 07 14:43:04.578509 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.578483 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:43:04.582171 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.582148 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7c45b865-82xxr"] Jul 07 14:43:04.665143 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:04.665116 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50466bd4-d325-40d7-9f33-e59786b120bd" path="/var/lib/kubelet/pods/50466bd4-d325-40d7-9f33-e59786b120bd/volumes" Jul 07 14:43:29.258394 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.258358 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d"] Jul 07 14:43:29.258791 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.258707 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50466bd4-d325-40d7-9f33-e59786b120bd" containerName="console" Jul 07 14:43:29.258791 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.258718 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="50466bd4-d325-40d7-9f33-e59786b120bd" containerName="console" Jul 07 14:43:29.258791 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.258775 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="50466bd4-d325-40d7-9f33-e59786b120bd" containerName="console" Jul 07 14:43:29.262766 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.262743 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.265306 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.265280 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:43:29.265463 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.265396 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f2qxz\"" Jul 07 14:43:29.265463 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.265406 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 14:43:29.279413 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.279386 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d"] Jul 07 14:43:29.344468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.344423 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.344693 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.344547 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frrpg\" (UniqueName: \"kubernetes.io/projected/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-kube-api-access-frrpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.445469 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.445431 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frrpg\" (UniqueName: \"kubernetes.io/projected/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-kube-api-access-frrpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.445674 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.445486 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.445935 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.445917 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.460208 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.460180 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frrpg\" (UniqueName: \"kubernetes.io/projected/0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1-kube-api-access-frrpg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ztl4d\" (UID: \"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.572461 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.572364 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" Jul 07 14:43:29.719773 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:29.719737 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d"] Jul 07 14:43:29.723057 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:43:29.723029 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f015b5d_71d8_4319_bb2c_4e6f0a3d50d1.slice/crio-966e283f309839936a5a3a55fb214c4529b1b0193905e07367165031007b877a WatchSource:0}: Error finding container 966e283f309839936a5a3a55fb214c4529b1b0193905e07367165031007b877a: Status 404 returned error can't find the container with id 966e283f309839936a5a3a55fb214c4529b1b0193905e07367165031007b877a Jul 07 14:43:30.669265 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:30.669214 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" event={"ID":"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1","Type":"ContainerStarted","Data":"966e283f309839936a5a3a55fb214c4529b1b0193905e07367165031007b877a"} Jul 07 14:43:32.680349 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:32.680313 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" event={"ID":"0f015b5d-71d8-4319-bb2c-4e6f0a3d50d1","Type":"ContainerStarted","Data":"4842775eb3c90957536d060c0ab09f0c13227f8075599c186f87fc81cc301a54"} Jul 07 14:43:32.703917 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:32.703799 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ztl4d" podStartSLOduration=0.983058508 podStartE2EDuration="3.703777044s" totalImagesPullingTime="2.720718536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:43:32.70196105 +0000 UTC m=+554.498068215" watchObservedRunningTime="2026-07-07 14:43:32.703777044 +0000 UTC m=+554.499884195" Jul 07 14:43:33.760568 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.760532 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9vsq5"] Jul 07 14:43:33.763931 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.763915 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.766553 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.766525 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 14:43:33.766739 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.766584 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g8vfd\"" Jul 07 14:43:33.766739 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.766633 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 14:43:33.777463 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.777441 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9vsq5"] Jul 07 14:43:33.783278 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.783242 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.783446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.783293 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6pg2\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-kube-api-access-f6pg2\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.884605 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.884565 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.884822 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.884675 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6pg2\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-kube-api-access-f6pg2\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.893466 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.893436 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:33.893466 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:33.893464 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6pg2\" (UniqueName: \"kubernetes.io/projected/07fc2d49-e55f-4fcb-afbd-81a12d5f987d-kube-api-access-f6pg2\") pod \"cert-manager-webhook-6486ffd997-9vsq5\" (UID: \"07fc2d49-e55f-4fcb-afbd-81a12d5f987d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:34.084229 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:34.084140 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:34.218538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:34.218466 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9vsq5"] Jul 07 14:43:34.220812 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:43:34.220789 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07fc2d49_e55f_4fcb_afbd_81a12d5f987d.slice/crio-604f01bbc7cc071e3ca259d4122040f2f6f41ce12e93cf4fbad36b2ac7b50793 WatchSource:0}: Error finding container 604f01bbc7cc071e3ca259d4122040f2f6f41ce12e93cf4fbad36b2ac7b50793: Status 404 returned error can't find the container with id 604f01bbc7cc071e3ca259d4122040f2f6f41ce12e93cf4fbad36b2ac7b50793 Jul 07 14:43:34.690948 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:34.690904 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" event={"ID":"07fc2d49-e55f-4fcb-afbd-81a12d5f987d","Type":"ContainerStarted","Data":"604f01bbc7cc071e3ca259d4122040f2f6f41ce12e93cf4fbad36b2ac7b50793"} Jul 07 14:43:35.892951 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:35.892894 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-klw8h"] Jul 07 14:43:35.896613 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:35.896591 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:35.898993 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:35.898970 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5d6nc\"" Jul 07 14:43:35.906214 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:35.906191 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-klw8h"] Jul 07 14:43:36.003732 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.003696 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ns84\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-kube-api-access-6ns84\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.003916 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.003772 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.104807 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.104776 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ns84\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-kube-api-access-6ns84\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.105003 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.104840 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.115779 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.115748 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.115930 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.115907 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ns84\" (UniqueName: \"kubernetes.io/projected/ba8790c5-69ae-487f-a64a-f46d1aa9ebc8-kube-api-access-6ns84\") pod \"cert-manager-cainjector-559cdd8c87-klw8h\" (UID: \"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.206824 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.206781 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" Jul 07 14:43:36.932687 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:36.932657 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-klw8h"] Jul 07 14:43:36.936181 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:43:36.936157 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba8790c5_69ae_487f_a64a_f46d1aa9ebc8.slice/crio-fd4d4aa62143090060be22fa8bfdbe5334607e8803e27d0c898e62c537738742 WatchSource:0}: Error finding container fd4d4aa62143090060be22fa8bfdbe5334607e8803e27d0c898e62c537738742: Status 404 returned error can't find the container with id fd4d4aa62143090060be22fa8bfdbe5334607e8803e27d0c898e62c537738742 Jul 07 14:43:37.707512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.707479 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" event={"ID":"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8","Type":"ContainerStarted","Data":"ac9f46c34c496073d9819f3c0b32292a10b62d74bb5860f344422bc3f2df7621"} Jul 07 14:43:37.707512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.707520 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" event={"ID":"ba8790c5-69ae-487f-a64a-f46d1aa9ebc8","Type":"ContainerStarted","Data":"fd4d4aa62143090060be22fa8bfdbe5334607e8803e27d0c898e62c537738742"} Jul 07 14:43:37.708971 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.708950 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" event={"ID":"07fc2d49-e55f-4fcb-afbd-81a12d5f987d","Type":"ContainerStarted","Data":"e770bed9bfc941df34e97d4e3690472fec5f4e8a95e01be8f56cb3ff8247d69f"} Jul 07 14:43:37.709080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.709014 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:43:37.724959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.724907 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-klw8h" podStartSLOduration=2.724887852 podStartE2EDuration="2.724887852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:43:37.722528095 +0000 UTC m=+559.518635245" watchObservedRunningTime="2026-07-07 14:43:37.724887852 +0000 UTC m=+559.520995001" Jul 07 14:43:37.737671 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:37.737604 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" podStartSLOduration=2.10176807 podStartE2EDuration="4.737585297s" totalImagesPullingTime="2.635817227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:43:37.736951531 +0000 UTC m=+559.533058682" watchObservedRunningTime="2026-07-07 14:43:37.737585297 +0000 UTC m=+559.533692447" Jul 07 14:43:43.715096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:43:43.715069 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9vsq5" Jul 07 14:44:09.761990 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.761958 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5"] Jul 07 14:44:09.768926 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.768902 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.772513 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.772490 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 14:44:09.778782 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.778760 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 14:44:09.778916 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.778882 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 14:44:09.779108 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.779092 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 14:44:09.779603 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.779591 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g8lnk\"" Jul 07 14:44:09.798733 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.798696 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-tmp\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.798920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.798762 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjlk\" (UniqueName: \"kubernetes.io/projected/c77a2397-f474-4b5a-8222-e522aebe350e-kube-api-access-7qjlk\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.798920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.798791 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-manifests\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.798920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.798826 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-webhook-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.798920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.798861 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.803063 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.803036 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5"] Jul 07 14:44:09.900088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900047 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjlk\" (UniqueName: \"kubernetes.io/projected/c77a2397-f474-4b5a-8222-e522aebe350e-kube-api-access-7qjlk\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.900088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900088 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-manifests\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.900309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900114 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-webhook-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.900309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900137 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.900309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900205 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-tmp\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.900539 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.900520 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-manifests\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.902554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.902529 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c77a2397-f474-4b5a-8222-e522aebe350e-tmp\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.902694 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.902627 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-webhook-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.902847 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.902829 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c77a2397-f474-4b5a-8222-e522aebe350e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:09.908906 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:09.908883 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjlk\" (UniqueName: \"kubernetes.io/projected/c77a2397-f474-4b5a-8222-e522aebe350e-kube-api-access-7qjlk\") pod \"opendatahub-operator-controller-manager-655bb48ff6-n5gz5\" (UID: \"c77a2397-f474-4b5a-8222-e522aebe350e\") " pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:10.079873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:10.079772 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:10.224060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:10.223926 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5"] Jul 07 14:44:10.227130 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:44:10.227102 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77a2397_f474_4b5a_8222_e522aebe350e.slice/crio-97f9f7297ff2af2ecf8aa330230ee24df7ff4a18a58a27a45c65103208040683 WatchSource:0}: Error finding container 97f9f7297ff2af2ecf8aa330230ee24df7ff4a18a58a27a45c65103208040683: Status 404 returned error can't find the container with id 97f9f7297ff2af2ecf8aa330230ee24df7ff4a18a58a27a45c65103208040683 Jul 07 14:44:10.868772 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:10.868725 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" event={"ID":"c77a2397-f474-4b5a-8222-e522aebe350e","Type":"ContainerStarted","Data":"97f9f7297ff2af2ecf8aa330230ee24df7ff4a18a58a27a45c65103208040683"} Jul 07 14:44:13.885817 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:13.885770 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" event={"ID":"c77a2397-f474-4b5a-8222-e522aebe350e","Type":"ContainerStarted","Data":"8e2b65d2fe746aaede63edbb288c09f670705f5858e8bc9f4eca0e80c0f41f94"} Jul 07 14:44:14.892246 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:14.892145 2590 generic.go:356] "Generic (PLEG): container finished" podID="c77a2397-f474-4b5a-8222-e522aebe350e" containerID="8e2b65d2fe746aaede63edbb288c09f670705f5858e8bc9f4eca0e80c0f41f94" exitCode=0 Jul 07 14:44:14.892246 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:14.892193 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" event={"ID":"c77a2397-f474-4b5a-8222-e522aebe350e","Type":"ContainerDied","Data":"8e2b65d2fe746aaede63edbb288c09f670705f5858e8bc9f4eca0e80c0f41f94"} Jul 07 14:44:15.899037 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:15.899003 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" event={"ID":"c77a2397-f474-4b5a-8222-e522aebe350e","Type":"ContainerStarted","Data":"73ff6c0ad92c38d70ad064700c21bbb735b2dedcfd7be92b3a04a949d40ca0c7"} Jul 07 14:44:15.899423 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:15.899124 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:15.920015 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:15.919950 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" podStartSLOduration=2.44607666 podStartE2EDuration="6.919926958s" totalImagesPullingTime="3.436488464s" totalInitContainerRuntime="1.037361834s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:44:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:44:15.91895774 +0000 UTC m=+597.715064891" watchObservedRunningTime="2026-07-07 14:44:15.919926958 +0000 UTC m=+597.716034108" Jul 07 14:44:26.905632 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:26.905595 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-655bb48ff6-n5gz5" Jul 07 14:44:30.211758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.211720 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh"] Jul 07 14:44:30.216310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.216288 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.219534 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.219509 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:44:30.220129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.220109 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:44:30.220285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.220228 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q8f7v\"" Jul 07 14:44:30.220285 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.220231 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 14:44:30.220427 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.220323 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 14:44:30.226117 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.226092 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh"] Jul 07 14:44:30.289990 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.289961 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/0ca24172-76b6-4618-8097-a66c0fe61b3d-kube-api-access-j84fd\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.290182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.290034 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca24172-76b6-4618-8097-a66c0fe61b3d-tls-certs\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.290182 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.290078 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca24172-76b6-4618-8097-a66c0fe61b3d-tmp\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.391147 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.391109 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca24172-76b6-4618-8097-a66c0fe61b3d-tls-certs\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.391337 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.391164 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca24172-76b6-4618-8097-a66c0fe61b3d-tmp\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.391337 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.391202 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/0ca24172-76b6-4618-8097-a66c0fe61b3d-kube-api-access-j84fd\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.393636 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.393610 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ca24172-76b6-4618-8097-a66c0fe61b3d-tmp\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.393865 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.393843 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca24172-76b6-4618-8097-a66c0fe61b3d-tls-certs\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.402345 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.402318 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84fd\" (UniqueName: \"kubernetes.io/projected/0ca24172-76b6-4618-8097-a66c0fe61b3d-kube-api-access-j84fd\") pod \"kube-auth-proxy-7f6b8bcfd-tcjnh\" (UID: \"0ca24172-76b6-4618-8097-a66c0fe61b3d\") " pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.526889 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.526790 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" Jul 07 14:44:30.705030 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.704912 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh"] Jul 07 14:44:30.707861 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:44:30.707816 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca24172_76b6_4618_8097_a66c0fe61b3d.slice/crio-f660b02bd9f06750af85770eca5ea467b31de40e7c36ebb4f4a0e3fc5e21e1a5 WatchSource:0}: Error finding container f660b02bd9f06750af85770eca5ea467b31de40e7c36ebb4f4a0e3fc5e21e1a5: Status 404 returned error can't find the container with id f660b02bd9f06750af85770eca5ea467b31de40e7c36ebb4f4a0e3fc5e21e1a5 Jul 07 14:44:30.710180 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.710140 2590 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:44:30.969260 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:30.969228 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" event={"ID":"0ca24172-76b6-4618-8097-a66c0fe61b3d","Type":"ContainerStarted","Data":"f660b02bd9f06750af85770eca5ea467b31de40e7c36ebb4f4a0e3fc5e21e1a5"} Jul 07 14:44:31.729457 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.729421 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:31.732709 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.732694 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.736759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.736579 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 14:44:31.736759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.736585 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 14:44:31.736759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.736582 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 14:44:31.736759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.736739 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-x697n\"" Jul 07 14:44:31.737074 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.736903 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 14:44:31.748719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.748684 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:31.804679 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804615 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.804881 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804697 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.804881 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804736 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.804881 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804761 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.804881 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804831 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phwqw\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.804881 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804867 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.805066 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.804897 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906208 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906172 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906436 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906215 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906436 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906270 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906556 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906431 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906556 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906483 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906556 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906516 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.906746 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.906583 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phwqw\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.907075 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.907050 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.909030 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.909002 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.909183 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.909162 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.909246 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.909196 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.909335 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.909321 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.914608 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.914587 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:31.915480 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:31.915457 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phwqw\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw\") pod \"istiod-openshift-gateway-7574459656-xtzlm\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:32.043214 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:32.043114 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:32.200307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:32.200248 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:32.204054 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:44:32.204026 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271ebe51_e180_4940_9380_2f25d1ace037.slice/crio-42885bab2372dba4727e1bb0597406a88c108ef03086d6fcd5dab21ad2ca20b9 WatchSource:0}: Error finding container 42885bab2372dba4727e1bb0597406a88c108ef03086d6fcd5dab21ad2ca20b9: Status 404 returned error can't find the container with id 42885bab2372dba4727e1bb0597406a88c108ef03086d6fcd5dab21ad2ca20b9 Jul 07 14:44:32.984433 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:32.984376 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" event={"ID":"271ebe51-e180-4940-9380-2f25d1ace037","Type":"ContainerStarted","Data":"42885bab2372dba4727e1bb0597406a88c108ef03086d6fcd5dab21ad2ca20b9"} Jul 07 14:44:34.998734 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:34.998687 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" event={"ID":"0ca24172-76b6-4618-8097-a66c0fe61b3d","Type":"ContainerStarted","Data":"36ab963ba1e268e1c1e5da4ebf6313207a70e666c5c0ef679cfd985fbd0679ea"} Jul 07 14:44:35.016872 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:35.016810 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f6b8bcfd-tcjnh" podStartSLOduration=1.658004252 podStartE2EDuration="5.016788327s" totalImagesPullingTime="3.358784075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:44:35.014829169 +0000 UTC m=+616.810936344" watchObservedRunningTime="2026-07-07 14:44:35.016788327 +0000 UTC m=+616.812895478" Jul 07 14:44:35.656513 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:35.656477 2590 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 07 14:44:35.656605 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:35.656542 2590 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 07 14:44:36.005758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:36.005631 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" event={"ID":"271ebe51-e180-4940-9380-2f25d1ace037","Type":"ContainerStarted","Data":"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3"} Jul 07 14:44:36.005758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:36.005724 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:36.007482 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:36.007445 2590 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xtzlm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:44:36.007607 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:36.007501 2590 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" podUID="271ebe51-e180-4940-9380-2f25d1ace037" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:44:36.034113 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:36.034055 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" podStartSLOduration=1.584795003 podStartE2EDuration="5.034033255s" totalImagesPullingTime="3.449238252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:44:36.032670274 +0000 UTC m=+617.828777423" watchObservedRunningTime="2026-07-07 14:44:36.034033255 +0000 UTC m=+617.830140406" Jul 07 14:44:37.011774 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:37.011745 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:41.116144 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.116050 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4"] Jul 07 14:44:41.119619 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.119593 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn"] Jul 07 14:44:41.119772 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.119733 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.123052 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.123028 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 14:44:41.123224 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.123092 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dd5xg\"" Jul 07 14:44:41.123409 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.123390 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.126851 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.126834 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 14:44:41.128242 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.128225 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kxnf9\"" Jul 07 14:44:41.138222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.138204 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4"] Jul 07 14:44:41.152047 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.152013 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn"] Jul 07 14:44:41.300155 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.300120 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5pd\" (UniqueName: \"kubernetes.io/projected/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-kube-api-access-gs5pd\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.300342 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.300175 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b525ed-a214-4eb0-a268-8d1ee9121d56-cert\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.300342 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.300228 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj5k6\" (UniqueName: \"kubernetes.io/projected/75b525ed-a214-4eb0-a268-8d1ee9121d56-kube-api-access-wj5k6\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.300511 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.300445 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.400983 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.400949 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b525ed-a214-4eb0-a268-8d1ee9121d56-cert\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.401185 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.400990 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj5k6\" (UniqueName: \"kubernetes.io/projected/75b525ed-a214-4eb0-a268-8d1ee9121d56-kube-api-access-wj5k6\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.401185 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.401109 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.401185 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.401138 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5pd\" (UniqueName: \"kubernetes.io/projected/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-kube-api-access-gs5pd\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.403590 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.403562 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75b525ed-a214-4eb0-a268-8d1ee9121d56-cert\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.403723 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.403608 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.414360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.414144 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj5k6\" (UniqueName: \"kubernetes.io/projected/75b525ed-a214-4eb0-a268-8d1ee9121d56-kube-api-access-wj5k6\") pod \"kserve-controller-manager-d6f4b65b8-jtmkn\" (UID: \"75b525ed-a214-4eb0-a268-8d1ee9121d56\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.415690 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.415636 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5pd\" (UniqueName: \"kubernetes.io/projected/ecd1e04a-0369-4532-82ef-e8e4cc03d1e0-kube-api-access-gs5pd\") pod \"llmisvc-controller-manager-777c6bd7d5-7jqj4\" (UID: \"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.431528 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.431496 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:41.438665 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.438625 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:41.590288 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.590254 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4"] Jul 07 14:44:41.594826 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:44:41.594799 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podecd1e04a_0369_4532_82ef_e8e4cc03d1e0.slice/crio-411dea52a0b541af5d7da03f305fc3b39d606e5db829028cbb4bc46ff3d5db42 WatchSource:0}: Error finding container 411dea52a0b541af5d7da03f305fc3b39d606e5db829028cbb4bc46ff3d5db42: Status 404 returned error can't find the container with id 411dea52a0b541af5d7da03f305fc3b39d606e5db829028cbb4bc46ff3d5db42 Jul 07 14:44:41.619051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:41.619031 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn"] Jul 07 14:44:41.621040 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:44:41.621016 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b525ed_a214_4eb0_a268_8d1ee9121d56.slice/crio-e5fee22af8b750ee1337f7d4b08b2f12994540d8563c8f9fedc7f7e061acf609 WatchSource:0}: Error finding container e5fee22af8b750ee1337f7d4b08b2f12994540d8563c8f9fedc7f7e061acf609: Status 404 returned error can't find the container with id e5fee22af8b750ee1337f7d4b08b2f12994540d8563c8f9fedc7f7e061acf609 Jul 07 14:44:42.037199 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:42.037162 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" event={"ID":"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0","Type":"ContainerStarted","Data":"411dea52a0b541af5d7da03f305fc3b39d606e5db829028cbb4bc46ff3d5db42"} Jul 07 14:44:42.038325 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:42.038300 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" event={"ID":"75b525ed-a214-4eb0-a268-8d1ee9121d56","Type":"ContainerStarted","Data":"e5fee22af8b750ee1337f7d4b08b2f12994540d8563c8f9fedc7f7e061acf609"} Jul 07 14:44:45.060170 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.060078 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" event={"ID":"ecd1e04a-0369-4532-82ef-e8e4cc03d1e0","Type":"ContainerStarted","Data":"962a98e3afbdc94809e181266b0972db753b4b8df9c1afc872df401dfb20a32f"} Jul 07 14:44:45.060170 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.060165 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:44:45.061668 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.061624 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" event={"ID":"75b525ed-a214-4eb0-a268-8d1ee9121d56","Type":"ContainerStarted","Data":"4afa78d1c239d98d922834f6019789696591f2785657c0423db6dd772a78ea0d"} Jul 07 14:44:45.061758 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.061702 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:44:45.119032 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.118978 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" podStartSLOduration=0.913616556 podStartE2EDuration="4.118961279s" totalImagesPullingTime="3.205344723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:44:45.115926687 +0000 UTC m=+626.912033838" watchObservedRunningTime="2026-07-07 14:44:45.118961279 +0000 UTC m=+626.915068429" Jul 07 14:44:45.195806 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.195753 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" podStartSLOduration=1.06245041 podStartE2EDuration="4.19573679s" totalImagesPullingTime="3.13328638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:44:45.191000896 +0000 UTC m=+626.987108046" watchObservedRunningTime="2026-07-07 14:44:45.19573679 +0000 UTC m=+626.991843939" Jul 07 14:44:45.415919 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.415882 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:45.416105 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.416081 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" podUID="271ebe51-e180-4940-9380-2f25d1ace037" containerName="discovery" containerID="cri-o://9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3" gracePeriod=30 Jul 07 14:44:45.676550 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.676472 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:45.744176 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744144 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744176 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744173 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744209 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phwqw\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744229 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744293 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744327 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.744446 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.744361 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token\") pod \"271ebe51-e180-4940-9380-2f25d1ace037\" (UID: \"271ebe51-e180-4940-9380-2f25d1ace037\") " Jul 07 14:44:45.745537 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.745448 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:44:45.747085 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747054 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw" (OuterVolumeSpecName: "kube-api-access-phwqw") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "kube-api-access-phwqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:44:45.747193 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747103 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:44:45.747193 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747151 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs" (OuterVolumeSpecName: "local-certs") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:44:45.747193 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747182 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:44:45.747317 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747252 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token" (OuterVolumeSpecName: "istio-token") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:44:45.747370 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.747342 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts" (OuterVolumeSpecName: "cacerts") pod "271ebe51-e180-4940-9380-2f25d1ace037" (UID: "271ebe51-e180-4940-9380-2f25d1ace037"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:44:45.845928 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845895 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phwqw\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-kube-api-access-phwqw\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.845928 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845925 2590 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/271ebe51-e180-4940-9380-2f25d1ace037-local-certs\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.846119 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845937 2590 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-cacerts\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.846119 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845950 2590 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-ca-configmap\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.846119 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845960 2590 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271ebe51-e180-4940-9380-2f25d1ace037-istio-token\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.846119 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845974 2590 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-kubeconfig\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:45.846119 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:45.845984 2590 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/271ebe51-e180-4940-9380-2f25d1ace037-istio-csr-dns-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:44:46.068722 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.068622 2590 generic.go:356] "Generic (PLEG): container finished" podID="271ebe51-e180-4940-9380-2f25d1ace037" containerID="9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3" exitCode=0 Jul 07 14:44:46.068722 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.068679 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" Jul 07 14:44:46.068722 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.068710 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" event={"ID":"271ebe51-e180-4940-9380-2f25d1ace037","Type":"ContainerDied","Data":"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3"} Jul 07 14:44:46.069277 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.068759 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm" event={"ID":"271ebe51-e180-4940-9380-2f25d1ace037","Type":"ContainerDied","Data":"42885bab2372dba4727e1bb0597406a88c108ef03086d6fcd5dab21ad2ca20b9"} Jul 07 14:44:46.069277 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.068781 2590 scope.go:117] "RemoveContainer" containerID="9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3" Jul 07 14:44:46.077436 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.077421 2590 scope.go:117] "RemoveContainer" containerID="9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3" Jul 07 14:44:46.077722 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:44:46.077701 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3\": container with ID starting with 9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3 not found: ID does not exist" containerID="9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3" Jul 07 14:44:46.077804 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.077726 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3"} err="failed to get container status \"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3\": rpc error: code = NotFound desc = could not find container \"9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3\": container with ID starting with 9583dda7dfab6526320aa060429431fd3d0d1a84f193bc1d5e75b7b7f965e3f3 not found: ID does not exist" Jul 07 14:44:46.096993 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.096967 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:46.103920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.103899 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xtzlm"] Jul 07 14:44:46.666667 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:44:46.666629 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="271ebe51-e180-4940-9380-2f25d1ace037" path="/var/lib/kubelet/pods/271ebe51-e180-4940-9380-2f25d1ace037/volumes" Jul 07 14:45:16.071070 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:16.071043 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7jqj4" Jul 07 14:45:16.074060 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:16.074040 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jtmkn" Jul 07 14:45:30.506262 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.506226 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:30.506752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.506578 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271ebe51-e180-4940-9380-2f25d1ace037" containerName="discovery" Jul 07 14:45:30.506752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.506589 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="271ebe51-e180-4940-9380-2f25d1ace037" containerName="discovery" Jul 07 14:45:30.506752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.506673 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="271ebe51-e180-4940-9380-2f25d1ace037" containerName="discovery" Jul 07 14:45:30.513463 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.513437 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:30.516793 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.516766 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fkd92\"" Jul 07 14:45:30.516793 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.516784 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 14:45:30.517040 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.516781 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 14:45:30.520099 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.520077 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:30.644509 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.644475 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fgwf\" (UniqueName: \"kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf\") pod \"kuadrant-operator-catalog-x6d5w\" (UID: \"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6\") " pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:30.744991 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.744957 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fgwf\" (UniqueName: \"kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf\") pod \"kuadrant-operator-catalog-x6d5w\" (UID: \"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6\") " pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:30.753017 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.752993 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fgwf\" (UniqueName: \"kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf\") pod \"kuadrant-operator-catalog-x6d5w\" (UID: \"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6\") " pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:30.826044 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.825953 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:30.964906 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.964867 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:30.969781 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:45:30.969618 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69d8b6a_a52b_4839_adc8_6d6a3dd8ffb6.slice/crio-9cbcc6b4b1d1f9a90c5af5c8cbee5bc21e5b4b790df27bd4debb7b0374e5429e WatchSource:0}: Error finding container 9cbcc6b4b1d1f9a90c5af5c8cbee5bc21e5b4b790df27bd4debb7b0374e5429e: Status 404 returned error can't find the container with id 9cbcc6b4b1d1f9a90c5af5c8cbee5bc21e5b4b790df27bd4debb7b0374e5429e Jul 07 14:45:30.969971 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:30.969884 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:31.083307 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.083231 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjn27"] Jul 07 14:45:31.087814 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.087799 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:31.095173 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.095147 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjn27"] Jul 07 14:45:31.249882 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.249852 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7kr\" (UniqueName: \"kubernetes.io/projected/301e649f-9457-4535-b69b-1abf1ea31d3f-kube-api-access-jf7kr\") pod \"kuadrant-operator-catalog-qjn27\" (UID: \"301e649f-9457-4535-b69b-1abf1ea31d3f\") " pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:31.286814 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.286776 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" event={"ID":"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6","Type":"ContainerStarted","Data":"9cbcc6b4b1d1f9a90c5af5c8cbee5bc21e5b4b790df27bd4debb7b0374e5429e"} Jul 07 14:45:31.350999 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.350892 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7kr\" (UniqueName: \"kubernetes.io/projected/301e649f-9457-4535-b69b-1abf1ea31d3f-kube-api-access-jf7kr\") pod \"kuadrant-operator-catalog-qjn27\" (UID: \"301e649f-9457-4535-b69b-1abf1ea31d3f\") " pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:31.381049 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.381022 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7kr\" (UniqueName: \"kubernetes.io/projected/301e649f-9457-4535-b69b-1abf1ea31d3f-kube-api-access-jf7kr\") pod \"kuadrant-operator-catalog-qjn27\" (UID: \"301e649f-9457-4535-b69b-1abf1ea31d3f\") " pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:31.398844 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.398810 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:31.535793 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:31.535771 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjn27"] Jul 07 14:45:31.537988 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:45:31.537959 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301e649f_9457_4535_b69b_1abf1ea31d3f.slice/crio-fd0c4a3e1a3a2a47690468ff0dd1d049d87aad848f64fa7c00df837b57d10e8e WatchSource:0}: Error finding container fd0c4a3e1a3a2a47690468ff0dd1d049d87aad848f64fa7c00df837b57d10e8e: Status 404 returned error can't find the container with id fd0c4a3e1a3a2a47690468ff0dd1d049d87aad848f64fa7c00df837b57d10e8e Jul 07 14:45:32.295681 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:32.295627 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" event={"ID":"301e649f-9457-4535-b69b-1abf1ea31d3f","Type":"ContainerStarted","Data":"fd0c4a3e1a3a2a47690468ff0dd1d049d87aad848f64fa7c00df837b57d10e8e"} Jul 07 14:45:33.303111 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.303062 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" event={"ID":"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6","Type":"ContainerStarted","Data":"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8"} Jul 07 14:45:33.303557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.303091 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" podUID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" containerName="registry-server" containerID="cri-o://9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8" gracePeriod=2 Jul 07 14:45:33.304864 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.304835 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" event={"ID":"301e649f-9457-4535-b69b-1abf1ea31d3f","Type":"ContainerStarted","Data":"4e0b62088711e8f833413b4b389fbccc029fb64ec438490e6f4a7ae57eeb961d"} Jul 07 14:45:33.320851 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.320798 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" podStartSLOduration=1.142336166 podStartE2EDuration="3.320780854s" totalImagesPullingTime="2.178444688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:45:33.318765725 +0000 UTC m=+675.114872886" watchObservedRunningTime="2026-07-07 14:45:33.320780854 +0000 UTC m=+675.116888003" Jul 07 14:45:33.337074 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.337025 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" podStartSLOduration=0.724575763 podStartE2EDuration="2.337008384s" totalImagesPullingTime="1.612432621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:45:33.335157359 +0000 UTC m=+675.131264510" watchObservedRunningTime="2026-07-07 14:45:33.337008384 +0000 UTC m=+675.133115545" Jul 07 14:45:33.557811 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.557782 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:33.567269 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.567245 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fgwf\" (UniqueName: \"kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf\") pod \"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6\" (UID: \"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6\") " Jul 07 14:45:33.569339 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.569317 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf" (OuterVolumeSpecName: "kube-api-access-4fgwf") pod "e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" (UID: "e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6"). InnerVolumeSpecName "kube-api-access-4fgwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:45:33.668136 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:33.668103 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fgwf\" (UniqueName: \"kubernetes.io/projected/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6-kube-api-access-4fgwf\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:45:34.310971 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.310939 2590 generic.go:356] "Generic (PLEG): container finished" podID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" containerID="9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8" exitCode=0 Jul 07 14:45:34.311373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.310981 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" Jul 07 14:45:34.311373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.311031 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" event={"ID":"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6","Type":"ContainerDied","Data":"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8"} Jul 07 14:45:34.311373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.311078 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x6d5w" event={"ID":"e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6","Type":"ContainerDied","Data":"9cbcc6b4b1d1f9a90c5af5c8cbee5bc21e5b4b790df27bd4debb7b0374e5429e"} Jul 07 14:45:34.311373 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.311104 2590 scope.go:117] "RemoveContainer" containerID="9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8" Jul 07 14:45:34.320776 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.320757 2590 scope.go:117] "RemoveContainer" containerID="9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8" Jul 07 14:45:34.321030 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:45:34.321015 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8\": container with ID starting with 9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8 not found: ID does not exist" containerID="9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8" Jul 07 14:45:34.321064 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.321039 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8"} err="failed to get container status \"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8\": rpc error: code = NotFound desc = could not find container \"9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8\": container with ID starting with 9d73be14fb28aaec9702494d46528f3ad98514a9078446ed0d489e428b1edcd8 not found: ID does not exist" Jul 07 14:45:34.332049 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.332025 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:34.335447 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.335419 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x6d5w"] Jul 07 14:45:34.667352 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:34.667320 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" path="/var/lib/kubelet/pods/e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6/volumes" Jul 07 14:45:41.399450 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:41.399415 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:41.399970 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:41.399471 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:41.422136 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:41.422108 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:45:42.374802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:45:42.374771 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qjn27" Jul 07 14:46:03.481405 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.481368 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh"] Jul 07 14:46:03.481856 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.481759 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" containerName="registry-server" Jul 07 14:46:03.481856 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.481772 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" containerName="registry-server" Jul 07 14:46:03.481856 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.481844 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69d8b6a-a52b-4839-adc8-6d6a3dd8ffb6" containerName="registry-server" Jul 07 14:46:03.486029 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.486013 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:03.491001 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.490982 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v2nk5\"" Jul 07 14:46:03.501447 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.501417 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh"] Jul 07 14:46:03.633708 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.633642 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgl27\" (UniqueName: \"kubernetes.io/projected/31ccd219-37a3-495e-989d-07c0a2c8e402-kube-api-access-zgl27\") pod \"authorino-operator-75cc8d5cb7-rf2bh\" (UID: \"31ccd219-37a3-495e-989d-07c0a2c8e402\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:03.734889 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.734797 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgl27\" (UniqueName: \"kubernetes.io/projected/31ccd219-37a3-495e-989d-07c0a2c8e402-kube-api-access-zgl27\") pod \"authorino-operator-75cc8d5cb7-rf2bh\" (UID: \"31ccd219-37a3-495e-989d-07c0a2c8e402\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:03.746585 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.746555 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgl27\" (UniqueName: \"kubernetes.io/projected/31ccd219-37a3-495e-989d-07c0a2c8e402-kube-api-access-zgl27\") pod \"authorino-operator-75cc8d5cb7-rf2bh\" (UID: \"31ccd219-37a3-495e-989d-07c0a2c8e402\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:03.795768 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.795735 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:03.940178 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:03.940127 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh"] Jul 07 14:46:03.942372 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:03.942347 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ccd219_37a3_495e_989d_07c0a2c8e402.slice/crio-5b66f1b2cb917213d8686c5d22e8eb7f1d87329108703060dd9f23825905d350 WatchSource:0}: Error finding container 5b66f1b2cb917213d8686c5d22e8eb7f1d87329108703060dd9f23825905d350: Status 404 returned error can't find the container with id 5b66f1b2cb917213d8686c5d22e8eb7f1d87329108703060dd9f23825905d350 Jul 07 14:46:04.458420 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:04.458378 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" event={"ID":"31ccd219-37a3-495e-989d-07c0a2c8e402","Type":"ContainerStarted","Data":"5b66f1b2cb917213d8686c5d22e8eb7f1d87329108703060dd9f23825905d350"} Jul 07 14:46:06.273920 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.273289 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2"] Jul 07 14:46:06.279286 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.279184 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:06.282365 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.282328 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 14:46:06.282509 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.282480 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pnc8b\"" Jul 07 14:46:06.296078 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.296053 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2"] Jul 07 14:46:06.359300 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.359212 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w472m\" (UniqueName: \"kubernetes.io/projected/9df194a6-7841-4312-b103-b2134651cf5b-kube-api-access-w472m\") pod \"dns-operator-controller-manager-864dd78c4c-4k4h2\" (UID: \"9df194a6-7841-4312-b103-b2134651cf5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:06.459927 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.459895 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w472m\" (UniqueName: \"kubernetes.io/projected/9df194a6-7841-4312-b103-b2134651cf5b-kube-api-access-w472m\") pod \"dns-operator-controller-manager-864dd78c4c-4k4h2\" (UID: \"9df194a6-7841-4312-b103-b2134651cf5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:06.471721 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.471675 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" event={"ID":"31ccd219-37a3-495e-989d-07c0a2c8e402","Type":"ContainerStarted","Data":"e925599cfff9f494c835466c23d0ae441751580f18a9405fc921d3cd351f1df3"} Jul 07 14:46:06.471873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.471786 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:06.474011 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.473995 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w472m\" (UniqueName: \"kubernetes.io/projected/9df194a6-7841-4312-b103-b2134651cf5b-kube-api-access-w472m\") pod \"dns-operator-controller-manager-864dd78c4c-4k4h2\" (UID: \"9df194a6-7841-4312-b103-b2134651cf5b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:06.501200 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.501138 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" podStartSLOduration=1.339736149 podStartE2EDuration="3.501120998s" totalImagesPullingTime="2.161384849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:06.499176219 +0000 UTC m=+708.295283369" watchObservedRunningTime="2026-07-07 14:46:06.501120998 +0000 UTC m=+708.297228147" Jul 07 14:46:06.589807 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.589767 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:06.735854 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:06.735830 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2"] Jul 07 14:46:06.738367 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:06.738336 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df194a6_7841_4312_b103_b2134651cf5b.slice/crio-ce199d73aaa016b9821a0ee77e4676d14a5366241db139ebbaece7cc408287d7 WatchSource:0}: Error finding container ce199d73aaa016b9821a0ee77e4676d14a5366241db139ebbaece7cc408287d7: Status 404 returned error can't find the container with id ce199d73aaa016b9821a0ee77e4676d14a5366241db139ebbaece7cc408287d7 Jul 07 14:46:07.479134 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:07.479101 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" event={"ID":"9df194a6-7841-4312-b103-b2134651cf5b","Type":"ContainerStarted","Data":"ce199d73aaa016b9821a0ee77e4676d14a5366241db139ebbaece7cc408287d7"} Jul 07 14:46:09.493563 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:09.493518 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" event={"ID":"9df194a6-7841-4312-b103-b2134651cf5b","Type":"ContainerStarted","Data":"0060e7c912868164625f44eb494910706f018fc889d152e6eb97b831c382650b"} Jul 07 14:46:09.493988 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:09.493588 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:09.520360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:09.520311 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" podStartSLOduration=1.351482978 podStartE2EDuration="3.520293086s" totalImagesPullingTime="2.168810108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:09.517846527 +0000 UTC m=+711.313953680" watchObservedRunningTime="2026-07-07 14:46:09.520293086 +0000 UTC m=+711.316400236" Jul 07 14:46:10.207902 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.207867 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r"] Jul 07 14:46:10.211481 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.211464 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.214538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.214516 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vrq7c\"" Jul 07 14:46:10.224088 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.224067 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r"] Jul 07 14:46:10.296741 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.296703 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.296913 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.296770 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hgnj\" (UniqueName: \"kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.398019 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.397982 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.398181 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.398037 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hgnj\" (UniqueName: \"kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.398341 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.398321 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.410503 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.410470 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hgnj\" (UniqueName: \"kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.522671 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.522547 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:10.672663 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:10.672620 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r"] Jul 07 14:46:10.678166 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:10.678142 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21146a19_506f_4194_9ad9_107ab015f715.slice/crio-0ecfe1dbe563c25c2cacd4628d1daca7dffb37375f75caaeb6a50be4a5672b04 WatchSource:0}: Error finding container 0ecfe1dbe563c25c2cacd4628d1daca7dffb37375f75caaeb6a50be4a5672b04: Status 404 returned error can't find the container with id 0ecfe1dbe563c25c2cacd4628d1daca7dffb37375f75caaeb6a50be4a5672b04 Jul 07 14:46:11.506631 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:11.506587 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" event={"ID":"21146a19-506f-4194-9ad9-107ab015f715","Type":"ContainerStarted","Data":"0ecfe1dbe563c25c2cacd4628d1daca7dffb37375f75caaeb6a50be4a5672b04"} Jul 07 14:46:12.220512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.220477 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs"] Jul 07 14:46:12.223968 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.223941 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:12.226444 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.226424 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qrhhd\"" Jul 07 14:46:12.234235 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.234209 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs"] Jul 07 14:46:12.314710 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.314674 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2tgv\" (UniqueName: \"kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv\") pod \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" (UID: \"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:12.415328 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.415286 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2tgv\" (UniqueName: \"kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv\") pod \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" (UID: \"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:12.425024 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.424994 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2tgv\" (UniqueName: \"kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv\") pod \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" (UID: \"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:12.535897 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.535812 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:12.689428 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:12.689395 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs"] Jul 07 14:46:12.693000 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:12.692972 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f38a7b3_f2d7_42f2_8e6c_36f1e7135a09.slice/crio-13a0b5b009e77fda8b66f9ea72b39ce47af456c6e3d246aff1d632a8e0b8b1df WatchSource:0}: Error finding container 13a0b5b009e77fda8b66f9ea72b39ce47af456c6e3d246aff1d632a8e0b8b1df: Status 404 returned error can't find the container with id 13a0b5b009e77fda8b66f9ea72b39ce47af456c6e3d246aff1d632a8e0b8b1df Jul 07 14:46:13.518929 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:13.518899 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" event={"ID":"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09","Type":"ContainerStarted","Data":"13a0b5b009e77fda8b66f9ea72b39ce47af456c6e3d246aff1d632a8e0b8b1df"} Jul 07 14:46:15.532468 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:15.532417 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" event={"ID":"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09","Type":"ContainerStarted","Data":"4bd6728ec4600ca7170e8487736af3c4793f9c500857a6fe742604e1a8ebb2cd"} Jul 07 14:46:15.532950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:15.532519 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:15.550288 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:15.550231 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" podStartSLOduration=1.578814914 podStartE2EDuration="3.550216186s" totalImagesPullingTime="1.971401272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:15.549678919 +0000 UTC m=+717.345786070" watchObservedRunningTime="2026-07-07 14:46:15.550216186 +0000 UTC m=+717.346323335" Jul 07 14:46:17.481493 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:17.481464 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rf2bh" Jul 07 14:46:17.545673 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:17.545626 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" event={"ID":"21146a19-506f-4194-9ad9-107ab015f715","Type":"ContainerStarted","Data":"15e5280c30fe373879a4a7aab46f2fa433b1f69594cf77f2f1ab21956bae4580"} Jul 07 14:46:17.545834 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:17.545705 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:17.565201 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:17.565155 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" podStartSLOduration=1.4988760970000001 podStartE2EDuration="7.565136318s" totalImagesPullingTime="6.066260221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:17.564244145 +0000 UTC m=+719.360351294" watchObservedRunningTime="2026-07-07 14:46:17.565136318 +0000 UTC m=+719.361243468" Jul 07 14:46:19.558076 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.558044 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr"] Jul 07 14:46:19.563078 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.563057 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.565360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.565340 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 14:46:19.565360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.565356 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ckssf\"" Jul 07 14:46:19.565545 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.565376 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 14:46:19.570545 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.570525 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr"] Jul 07 14:46:19.586226 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.586195 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c41a65-2bd6-437d-bd69-792370697365-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.586372 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.586237 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c41a65-2bd6-437d-bd69-792370697365-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.586372 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.586319 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzck5\" (UniqueName: \"kubernetes.io/projected/d8c41a65-2bd6-437d-bd69-792370697365-kube-api-access-zzck5\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.687544 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.687498 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c41a65-2bd6-437d-bd69-792370697365-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.687544 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.687542 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c41a65-2bd6-437d-bd69-792370697365-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.687847 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.687563 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzck5\" (UniqueName: \"kubernetes.io/projected/d8c41a65-2bd6-437d-bd69-792370697365-kube-api-access-zzck5\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.688177 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.688153 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c41a65-2bd6-437d-bd69-792370697365-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.690039 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.690017 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c41a65-2bd6-437d-bd69-792370697365-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.696512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.696487 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzck5\" (UniqueName: \"kubernetes.io/projected/d8c41a65-2bd6-437d-bd69-792370697365-kube-api-access-zzck5\") pod \"kuadrant-console-plugin-66b5774985-6rvqr\" (UID: \"d8c41a65-2bd6-437d-bd69-792370697365\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:19.873716 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:19.873601 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" Jul 07 14:46:20.009080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:20.009060 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr"] Jul 07 14:46:20.011542 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:20.011519 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8c41a65_2bd6_437d_bd69_792370697365.slice/crio-0dc4f24e6f42bae632f0ed9aae0f7d91bfe778aa46123c5619df1baebcdcecdc WatchSource:0}: Error finding container 0dc4f24e6f42bae632f0ed9aae0f7d91bfe778aa46123c5619df1baebcdcecdc: Status 404 returned error can't find the container with id 0dc4f24e6f42bae632f0ed9aae0f7d91bfe778aa46123c5619df1baebcdcecdc Jul 07 14:46:20.501808 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:20.501773 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4k4h2" Jul 07 14:46:20.561715 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:20.561682 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" event={"ID":"d8c41a65-2bd6-437d-bd69-792370697365","Type":"ContainerStarted","Data":"0dc4f24e6f42bae632f0ed9aae0f7d91bfe778aa46123c5619df1baebcdcecdc"} Jul 07 14:46:26.541450 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:26.541409 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:28.553198 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:28.553168 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:29.807719 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.807682 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969"] Jul 07 14:46:29.816667 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.816627 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:29.831417 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.831374 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969"] Jul 07 14:46:29.888398 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.888361 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:29.888603 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.888402 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kv4\" (UniqueName: \"kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:29.989638 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.989598 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:29.989638 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.989638 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kv4\" (UniqueName: \"kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:29.990145 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:29.990097 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:30.003118 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.003058 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kv4\" (UniqueName: \"kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4\") pod \"kuadrant-operator-controller-manager-55467d9f7-hx969\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:30.130444 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.130346 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:30.352855 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.352813 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969"] Jul 07 14:46:30.358120 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.358079 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969"] Jul 07 14:46:30.367157 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.367132 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r"] Jul 07 14:46:30.367421 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.367397 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" podUID="21146a19-506f-4194-9ad9-107ab015f715" containerName="manager" containerID="cri-o://15e5280c30fe373879a4a7aab46f2fa433b1f69594cf77f2f1ab21956bae4580" gracePeriod=2 Jul 07 14:46:30.385982 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.385948 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:46:30.389869 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.389842 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.392098 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.392058 2590 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"21146a19-506f-4194-9ad9-107ab015f715\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:30.394927 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.394880 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:30.396230 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.396207 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r"] Jul 07 14:46:30.416128 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.415667 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs"] Jul 07 14:46:30.416128 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.415904 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" containerName="manager" containerID="cri-o://4bd6728ec4600ca7170e8487736af3c4793f9c500857a6fe742604e1a8ebb2cd" gracePeriod=2 Jul 07 14:46:30.418967 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.418738 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:46:30.421591 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.421531 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:30.422232 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.422212 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21146a19-506f-4194-9ad9-107ab015f715" containerName="manager" Jul 07 14:46:30.422333 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.422236 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="21146a19-506f-4194-9ad9-107ab015f715" containerName="manager" Jul 07 14:46:30.422390 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.422344 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="21146a19-506f-4194-9ad9-107ab015f715" containerName="manager" Jul 07 14:46:30.426416 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.426395 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs"] Jul 07 14:46:30.426529 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.426489 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.440153 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.440113 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:30.444842 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.444821 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:30.454750 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.454720 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd"] Jul 07 14:46:30.455344 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.455322 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" containerName="manager" Jul 07 14:46:30.455344 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.455346 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" containerName="manager" Jul 07 14:46:30.455521 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.455453 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" containerName="manager" Jul 07 14:46:30.459255 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.459235 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:30.462217 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.462184 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:30.464373 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.464166 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:30.471011 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.470980 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd"] Jul 07 14:46:30.484197 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:30.483636 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:30.494672 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.494613 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.495265 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.495242 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbkp\" (UniqueName: \"kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.495367 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.495347 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.495483 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.495463 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccln\" (UniqueName: \"kubernetes.io/projected/5a487598-ee41-45cb-b3a6-b2eee5974cc6-kube-api-access-2ccln\") pod \"limitador-operator-controller-manager-859d7b78bd-k7dsd\" (UID: \"5a487598-ee41-45cb-b3a6-b2eee5974cc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:30.495601 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.495539 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.596242 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596203 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.596242 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596242 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbkp\" (UniqueName: \"kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.596552 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596450 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.596552 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596515 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccln\" (UniqueName: \"kubernetes.io/projected/5a487598-ee41-45cb-b3a6-b2eee5974cc6-kube-api-access-2ccln\") pod \"limitador-operator-controller-manager-859d7b78bd-k7dsd\" (UID: \"5a487598-ee41-45cb-b3a6-b2eee5974cc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:30.596686 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596564 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.596686 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596627 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.597035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.596991 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.605422 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.605398 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccln\" (UniqueName: \"kubernetes.io/projected/5a487598-ee41-45cb-b3a6-b2eee5974cc6-kube-api-access-2ccln\") pod \"limitador-operator-controller-manager-859d7b78bd-k7dsd\" (UID: \"5a487598-ee41-45cb-b3a6-b2eee5974cc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:30.606065 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.606035 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m\") pod \"kuadrant-operator-controller-manager-55467d9f7-74xdl\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.606360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.606337 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbkp\" (UniqueName: \"kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pv4x2\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.790427 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.790381 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:30.799559 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.799526 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:30.808525 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:30.808496 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:43.717791 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.717742 2590 generic.go:356] "Generic (PLEG): container finished" podID="21146a19-506f-4194-9ad9-107ab015f715" containerID="15e5280c30fe373879a4a7aab46f2fa433b1f69594cf77f2f1ab21956bae4580" exitCode=0 Jul 07 14:46:43.722761 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.721829 2590 generic.go:356] "Generic (PLEG): container finished" podID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" containerID="4bd6728ec4600ca7170e8487736af3c4793f9c500857a6fe742604e1a8ebb2cd" exitCode=0 Jul 07 14:46:43.745003 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.744833 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:43.748310 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:43.748280 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:43.764242 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.763691 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:43.766088 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:43.765919 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:43.766930 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.766881 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd"] Jul 07 14:46:43.767811 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:43.767777 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a487598_ee41_45cb_b3a6_b2eee5974cc6.slice/crio-7ad3d760664de4e44b6a073eace70b79385a038c71539fde27331fad27e1d768 WatchSource:0}: Error finding container 7ad3d760664de4e44b6a073eace70b79385a038c71539fde27331fad27e1d768: Status 404 returned error can't find the container with id 7ad3d760664de4e44b6a073eace70b79385a038c71539fde27331fad27e1d768 Jul 07 14:46:43.767924 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:43.767826 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:43.835234 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.835208 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2tgv\" (UniqueName: \"kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv\") pod \"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09\" (UID: \"8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09\") " Jul 07 14:46:43.835342 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.835238 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hgnj\" (UniqueName: \"kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj\") pod \"21146a19-506f-4194-9ad9-107ab015f715\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " Jul 07 14:46:43.835440 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.835422 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume\") pod \"21146a19-506f-4194-9ad9-107ab015f715\" (UID: \"21146a19-506f-4194-9ad9-107ab015f715\") " Jul 07 14:46:43.835767 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.835744 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "21146a19-506f-4194-9ad9-107ab015f715" (UID: "21146a19-506f-4194-9ad9-107ab015f715"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:46:43.837233 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.837211 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv" (OuterVolumeSpecName: "kube-api-access-p2tgv") pod "8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" (UID: "8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09"). InnerVolumeSpecName "kube-api-access-p2tgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:46:43.837233 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.837221 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj" (OuterVolumeSpecName: "kube-api-access-6hgnj") pod "21146a19-506f-4194-9ad9-107ab015f715" (UID: "21146a19-506f-4194-9ad9-107ab015f715"). InnerVolumeSpecName "kube-api-access-6hgnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:46:43.937080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.937045 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2tgv\" (UniqueName: \"kubernetes.io/projected/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09-kube-api-access-p2tgv\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:43.937080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.937074 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hgnj\" (UniqueName: \"kubernetes.io/projected/21146a19-506f-4194-9ad9-107ab015f715-kube-api-access-6hgnj\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:43.937080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:43.937083 2590 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21146a19-506f-4194-9ad9-107ab015f715-extensions-socket-volume\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:44.012854 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.012830 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:46:44.015846 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:44.015814 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad7e703_3331_420c_9047_223a12aa3fc8.slice/crio-6b9ce04d0e64c00efdf45f1054eb82b13cc8011d28a8aa4223003546e3d4b26f WatchSource:0}: Error finding container 6b9ce04d0e64c00efdf45f1054eb82b13cc8011d28a8aa4223003546e3d4b26f: Status 404 returned error can't find the container with id 6b9ce04d0e64c00efdf45f1054eb82b13cc8011d28a8aa4223003546e3d4b26f Jul 07 14:46:44.016617 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.016595 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:44.019451 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:44.019431 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcd9ab4_3e4d_4a52_bbde_2a38de1b7714.slice/crio-3d685a0b3e1e69ad3cd43818d11209b5c57f44e6b8d4f6d2714a277e8642b821 WatchSource:0}: Error finding container 3d685a0b3e1e69ad3cd43818d11209b5c57f44e6b8d4f6d2714a277e8642b821: Status 404 returned error can't find the container with id 3d685a0b3e1e69ad3cd43818d11209b5c57f44e6b8d4f6d2714a277e8642b821 Jul 07 14:46:44.665853 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.665824 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21146a19-506f-4194-9ad9-107ab015f715" path="/var/lib/kubelet/pods/21146a19-506f-4194-9ad9-107ab015f715/volumes" Jul 07 14:46:44.666171 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.666157 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" path="/var/lib/kubelet/pods/8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09/volumes" Jul 07 14:46:44.728885 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.728854 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:44.729354 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.728860 2590 scope.go:117] "RemoveContainer" containerID="15e5280c30fe373879a4a7aab46f2fa433b1f69594cf77f2f1ab21956bae4580" Jul 07 14:46:44.730691 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.730672 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:44.731206 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.731178 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:44.732786 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.732751 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" event={"ID":"5a487598-ee41-45cb-b3a6-b2eee5974cc6","Type":"ContainerStarted","Data":"904aecebe7cdfcf3665c25d85af1f7f0841c22900cf9fe505a5f7a0436b0cd9a"} Jul 07 14:46:44.732891 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.732812 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" event={"ID":"5a487598-ee41-45cb-b3a6-b2eee5974cc6","Type":"ContainerStarted","Data":"7ad3d760664de4e44b6a073eace70b79385a038c71539fde27331fad27e1d768"} Jul 07 14:46:44.732983 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.732964 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:44.733194 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.733155 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:44.734479 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.734454 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" event={"ID":"d8c41a65-2bd6-437d-bd69-792370697365","Type":"ContainerStarted","Data":"7f4eefd62cfdae4001b3e84bb835dc545e7c28ea44fe6cfac3b5e13e37a458da"} Jul 07 14:46:44.735131 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.735108 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:44.736115 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.736088 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" event={"ID":"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714","Type":"ContainerStarted","Data":"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895"} Jul 07 14:46:44.736202 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.736137 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:44.736202 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.736155 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" event={"ID":"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714","Type":"ContainerStarted","Data":"3d685a0b3e1e69ad3cd43818d11209b5c57f44e6b8d4f6d2714a277e8642b821"} Jul 07 14:46:44.736789 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.736765 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:44.737781 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.737760 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" event={"ID":"7ad7e703-3331-420c-9047-223a12aa3fc8","Type":"ContainerStarted","Data":"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72"} Jul 07 14:46:44.737868 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.737800 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" event={"ID":"7ad7e703-3331-420c-9047-223a12aa3fc8","Type":"ContainerStarted","Data":"6b9ce04d0e64c00efdf45f1054eb82b13cc8011d28a8aa4223003546e3d4b26f"} Jul 07 14:46:44.737921 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.737896 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:44.739394 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.739379 2590 scope.go:117] "RemoveContainer" containerID="4bd6728ec4600ca7170e8487736af3c4793f9c500857a6fe742604e1a8ebb2cd" Jul 07 14:46:44.754500 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.754476 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:44.754720 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.754682 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6rvqr" podStartSLOduration=2.104780237 podStartE2EDuration="25.754668772s" totalImagesPullingTime="23.649888535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:44.752536732 +0000 UTC m=+746.548643882" watchObservedRunningTime="2026-07-07 14:46:44.754668772 +0000 UTC m=+746.550775918" Jul 07 14:46:44.775170 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.775120 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" podStartSLOduration=14.775103267 podStartE2EDuration="14.775103267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:44.77384799 +0000 UTC m=+746.569955139" watchObservedRunningTime="2026-07-07 14:46:44.775103267 +0000 UTC m=+746.571210395" Jul 07 14:46:44.775807 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.775778 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-z4wrs\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="8f38a7b3-f2d7-42f2-8e6c-36f1e7135a09" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z4wrs" Jul 07 14:46:44.797852 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.797726 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" podStartSLOduration=14.79770264 podStartE2EDuration="14.79770264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:44.796876678 +0000 UTC m=+746.592984294" watchObservedRunningTime="2026-07-07 14:46:44.79770264 +0000 UTC m=+746.593809791" Jul 07 14:46:44.816031 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:44.815969 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" podStartSLOduration=14.815948231 podStartE2EDuration="14.815948231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:44.815467343 +0000 UTC m=+746.611574494" watchObservedRunningTime="2026-07-07 14:46:44.815948231 +0000 UTC m=+746.612055390" Jul 07 14:46:44.817369 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:44.817336 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zrz9r\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="21146a19-506f-4194-9ad9-107ab015f715" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrz9r" Jul 07 14:46:46.108151 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:46.108112 2590 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-hx969_kuadrant-system_678b78a2-9da6-438b-8803-f8b2eb5318c8_0(65716ae6fe220f22753751eafb3e5970c4ca69881e2edc8fc6daf76731750d5d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-hx969 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 07 14:46:46.108440 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:46.108176 2590 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-hx969_kuadrant-system_678b78a2-9da6-438b-8803-f8b2eb5318c8_0(65716ae6fe220f22753751eafb3e5970c4ca69881e2edc8fc6daf76731750d5d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-hx969 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:46.751538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.751507 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:46.753978 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:46.753948 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hx969\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:46.760570 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.760550 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:46.762503 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:46.762481 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hx969\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:46.864914 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.864888 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5kv4\" (UniqueName: \"kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4\") pod \"678b78a2-9da6-438b-8803-f8b2eb5318c8\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " Jul 07 14:46:46.865048 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.864954 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume\") pod \"678b78a2-9da6-438b-8803-f8b2eb5318c8\" (UID: \"678b78a2-9da6-438b-8803-f8b2eb5318c8\") " Jul 07 14:46:46.865206 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.865184 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "678b78a2-9da6-438b-8803-f8b2eb5318c8" (UID: "678b78a2-9da6-438b-8803-f8b2eb5318c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:46:46.866841 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.866824 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4" (OuterVolumeSpecName: "kube-api-access-x5kv4") pod "678b78a2-9da6-438b-8803-f8b2eb5318c8" (UID: "678b78a2-9da6-438b-8803-f8b2eb5318c8"). InnerVolumeSpecName "kube-api-access-x5kv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:46:46.966309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.966275 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5kv4\" (UniqueName: \"kubernetes.io/projected/678b78a2-9da6-438b-8803-f8b2eb5318c8-kube-api-access-x5kv4\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:46.966309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:46.966305 2590 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/678b78a2-9da6-438b-8803-f8b2eb5318c8-extensions-socket-volume\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:47.757053 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:47.757022 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:47.759473 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:47.759445 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hx969\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:47.765102 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:47.765073 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hx969\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:48.664503 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:48.664466 2590 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-hx969\" is forbidden: User \"system:node:ip-10-0-131-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-126.ec2.internal' and this object" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hx969" Jul 07 14:46:48.667142 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:48.667118 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="678b78a2-9da6-438b-8803-f8b2eb5318c8" path="/var/lib/kubelet/pods/678b78a2-9da6-438b-8803-f8b2eb5318c8/volumes" Jul 07 14:46:55.748287 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:55.748255 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7dsd" Jul 07 14:46:55.748697 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:55.748386 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:55.748751 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:55.748705 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:46:55.849318 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:55.849290 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:55.849482 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:55.849461 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" podUID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" containerName="manager" containerID="cri-o://f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895" gracePeriod=10 Jul 07 14:46:56.113554 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.113527 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:56.149020 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.148993 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume\") pod \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " Jul 07 14:46:56.149217 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.149057 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbkp\" (UniqueName: \"kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp\") pod \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\" (UID: \"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714\") " Jul 07 14:46:56.149453 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.149424 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" (UID: "7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:46:56.151440 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.151411 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp" (OuterVolumeSpecName: "kube-api-access-ffbkp") pod "7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" (UID: "7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714"). InnerVolumeSpecName "kube-api-access-ffbkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:46:56.154638 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.154612 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:46:56.155034 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.155018 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" containerName="manager" Jul 07 14:46:56.155034 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.155033 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" containerName="manager" Jul 07 14:46:56.155173 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.155147 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" containerName="manager" Jul 07 14:46:56.158377 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.158360 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.172597 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.172574 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:46:56.250065 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.250034 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.250222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.250084 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvm2d\" (UniqueName: \"kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.250222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.250201 2590 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-extensions-socket-volume\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:56.250222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.250219 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbkp\" (UniqueName: \"kubernetes.io/projected/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714-kube-api-access-ffbkp\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:46:56.351191 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.351107 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.351191 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.351150 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvm2d\" (UniqueName: \"kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.351480 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.351460 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.362295 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.362271 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvm2d\" (UniqueName: \"kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d\") pod \"kuadrant-operator-controller-manager-86878c769f-bm4z8\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.469501 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.469463 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.622957 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.622866 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:46:56.629098 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:46:56.629068 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8bbfff_afa9_4fd4_894c_8b999ebf8f9b.slice/crio-8070625b715ef47be9eef18c462f8fe39847098b57fb634441fc294c384c9435 WatchSource:0}: Error finding container 8070625b715ef47be9eef18c462f8fe39847098b57fb634441fc294c384c9435: Status 404 returned error can't find the container with id 8070625b715ef47be9eef18c462f8fe39847098b57fb634441fc294c384c9435 Jul 07 14:46:56.808220 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.808183 2590 generic.go:356] "Generic (PLEG): container finished" podID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" containerID="f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895" exitCode=0 Jul 07 14:46:56.808682 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.808250 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" Jul 07 14:46:56.808682 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.808264 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" event={"ID":"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714","Type":"ContainerDied","Data":"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895"} Jul 07 14:46:56.808682 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.808327 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2" event={"ID":"7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714","Type":"ContainerDied","Data":"3d685a0b3e1e69ad3cd43818d11209b5c57f44e6b8d4f6d2714a277e8642b821"} Jul 07 14:46:56.808682 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.808357 2590 scope.go:117] "RemoveContainer" containerID="f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895" Jul 07 14:46:56.810475 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.810441 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" event={"ID":"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b","Type":"ContainerStarted","Data":"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56"} Jul 07 14:46:56.810615 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.810502 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" event={"ID":"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b","Type":"ContainerStarted","Data":"8070625b715ef47be9eef18c462f8fe39847098b57fb634441fc294c384c9435"} Jul 07 14:46:56.811082 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.811058 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:46:56.818151 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.818127 2590 scope.go:117] "RemoveContainer" containerID="f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895" Jul 07 14:46:56.818515 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:46:56.818493 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895\": container with ID starting with f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895 not found: ID does not exist" containerID="f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895" Jul 07 14:46:56.818586 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.818527 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895"} err="failed to get container status \"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895\": rpc error: code = NotFound desc = could not find container \"f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895\": container with ID starting with f29d53c456b971bd9ac3b812c31cd88e79a53056b0df65ffe1c13b75cc19e895 not found: ID does not exist" Jul 07 14:46:56.870487 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.870438 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" podStartSLOduration=0.870422602 podStartE2EDuration="870.422602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:56.865547003 +0000 UTC m=+758.661654154" watchObservedRunningTime="2026-07-07 14:46:56.870422602 +0000 UTC m=+758.666529733" Jul 07 14:46:56.903319 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.903287 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:56.905230 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:56.905203 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pv4x2"] Jul 07 14:46:58.667538 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:46:58.667503 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714" path="/var/lib/kubelet/pods/7fcd9ab4-3e4d-4a52-bbde-2a38de1b7714/volumes" Jul 07 14:47:07.822153 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:07.822114 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:47:07.870938 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:07.870904 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:47:07.871170 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:07.871139 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" podUID="7ad7e703-3331-420c-9047-223a12aa3fc8" containerName="manager" containerID="cri-o://63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72" gracePeriod=10 Jul 07 14:47:08.682116 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.682078 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:47:08.766950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.766869 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume\") pod \"7ad7e703-3331-420c-9047-223a12aa3fc8\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " Jul 07 14:47:08.766950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.766917 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m\") pod \"7ad7e703-3331-420c-9047-223a12aa3fc8\" (UID: \"7ad7e703-3331-420c-9047-223a12aa3fc8\") " Jul 07 14:47:08.767310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.767283 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ad7e703-3331-420c-9047-223a12aa3fc8" (UID: "7ad7e703-3331-420c-9047-223a12aa3fc8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:47:08.769065 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.769037 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m" (OuterVolumeSpecName: "kube-api-access-hdq2m") pod "7ad7e703-3331-420c-9047-223a12aa3fc8" (UID: "7ad7e703-3331-420c-9047-223a12aa3fc8"). InnerVolumeSpecName "kube-api-access-hdq2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:47:08.868222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.868185 2590 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ad7e703-3331-420c-9047-223a12aa3fc8-extensions-socket-volume\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:47:08.868222 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.868214 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/7ad7e703-3331-420c-9047-223a12aa3fc8-kube-api-access-hdq2m\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:47:08.880929 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.880895 2590 generic.go:356] "Generic (PLEG): container finished" podID="7ad7e703-3331-420c-9047-223a12aa3fc8" containerID="63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72" exitCode=0 Jul 07 14:47:08.881096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.880946 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" event={"ID":"7ad7e703-3331-420c-9047-223a12aa3fc8","Type":"ContainerDied","Data":"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72"} Jul 07 14:47:08.881096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.880991 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" event={"ID":"7ad7e703-3331-420c-9047-223a12aa3fc8","Type":"ContainerDied","Data":"6b9ce04d0e64c00efdf45f1054eb82b13cc8011d28a8aa4223003546e3d4b26f"} Jul 07 14:47:08.881096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.880948 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl" Jul 07 14:47:08.881096 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.881021 2590 scope.go:117] "RemoveContainer" containerID="63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72" Jul 07 14:47:08.890819 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.890769 2590 scope.go:117] "RemoveContainer" containerID="63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72" Jul 07 14:47:08.891098 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:47:08.891078 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72\": container with ID starting with 63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72 not found: ID does not exist" containerID="63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72" Jul 07 14:47:08.891169 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.891107 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72"} err="failed to get container status \"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72\": rpc error: code = NotFound desc = could not find container \"63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72\": container with ID starting with 63c00359a2d0ceb66a6e8e2b32e8900a390a6091f47764bbcdb943f85e31aa72 not found: ID does not exist" Jul 07 14:47:08.904825 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.904799 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:47:08.907412 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:08.907390 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-74xdl"] Jul 07 14:47:10.666479 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:10.666443 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad7e703-3331-420c-9047-223a12aa3fc8" path="/var/lib/kubelet/pods/7ad7e703-3331-420c-9047-223a12aa3fc8/volumes" Jul 07 14:47:28.287220 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.287189 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:28.287809 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.287790 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad7e703-3331-420c-9047-223a12aa3fc8" containerName="manager" Jul 07 14:47:28.287906 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.287811 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad7e703-3331-420c-9047-223a12aa3fc8" containerName="manager" Jul 07 14:47:28.287959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.287927 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad7e703-3331-420c-9047-223a12aa3fc8" containerName="manager" Jul 07 14:47:28.344287 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.344250 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:28.344484 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.344385 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.346783 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.346754 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 14:47:28.387100 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.387070 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:28.444001 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.443961 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vpl5\" (UniqueName: \"kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.444198 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.444129 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.545086 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.544996 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.545086 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.545035 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vpl5\" (UniqueName: \"kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.545710 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.545687 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.554043 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.554014 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vpl5\" (UniqueName: \"kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5\") pod \"limitador-limitador-64c94fd64f-jt2wc\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.656844 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.656808 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:28.743870 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.743839 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:47:28.747959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.747936 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.758564 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.758535 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:47:28.793002 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.792978 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:47:28.817260 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.817062 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:28.822869 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:47:28.821978 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeee578c_53a9_4d43_92f0_160df3f3703e.slice/crio-8472213911ab9cb617af4300bf13a75b8cf752eefae6df24c4ae3244b650a79b WatchSource:0}: Error finding container 8472213911ab9cb617af4300bf13a75b8cf752eefae6df24c4ae3244b650a79b: Status 404 returned error can't find the container with id 8472213911ab9cb617af4300bf13a75b8cf752eefae6df24c4ae3244b650a79b Jul 07 14:47:28.847809 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.847778 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg24v\" (UniqueName: \"kubernetes.io/projected/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-kube-api-access-vg24v\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.847999 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.847833 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-config-file\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.949050 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.949011 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-config-file\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.949251 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.949145 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg24v\" (UniqueName: \"kubernetes.io/projected/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-kube-api-access-vg24v\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.949665 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.949628 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-config-file\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.957777 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.957748 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg24v\" (UniqueName: \"kubernetes.io/projected/2273c35a-8e22-4bd2-8ec0-29dbce0317cb-kube-api-access-vg24v\") pod \"limitador-limitador-54d6d988d5-cldz6\" (UID: \"2273c35a-8e22-4bd2-8ec0-29dbce0317cb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:28.987478 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:28.987436 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" event={"ID":"aeee578c-53a9-4d43-92f0-160df3f3703e","Type":"ContainerStarted","Data":"8472213911ab9cb617af4300bf13a75b8cf752eefae6df24c4ae3244b650a79b"} Jul 07 14:47:29.066865 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:29.066778 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:29.207465 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:29.207438 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:47:29.209884 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:47:29.209850 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2273c35a_8e22_4bd2_8ec0_29dbce0317cb.slice/crio-391b1902a7beb171e911f46455216ded656309ce1010a12152d79eeb6e500bd0 WatchSource:0}: Error finding container 391b1902a7beb171e911f46455216ded656309ce1010a12152d79eeb6e500bd0: Status 404 returned error can't find the container with id 391b1902a7beb171e911f46455216ded656309ce1010a12152d79eeb6e500bd0 Jul 07 14:47:29.997557 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:29.997475 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" event={"ID":"2273c35a-8e22-4bd2-8ec0-29dbce0317cb","Type":"ContainerStarted","Data":"391b1902a7beb171e911f46455216ded656309ce1010a12152d79eeb6e500bd0"} Jul 07 14:47:33.016703 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.016640 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" event={"ID":"aeee578c-53a9-4d43-92f0-160df3f3703e","Type":"ContainerStarted","Data":"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d"} Jul 07 14:47:33.017171 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.016785 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:33.018168 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.018147 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" event={"ID":"2273c35a-8e22-4bd2-8ec0-29dbce0317cb","Type":"ContainerStarted","Data":"e479044fdc26f7e250b70de69c981cff05d74cce160b31f033e8cce2b38f00c7"} Jul 07 14:47:33.018251 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.018232 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:33.034839 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.034796 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" podStartSLOduration=1.530169917 podStartE2EDuration="5.034783573s" totalImagesPullingTime="3.504613656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:47:33.033455761 +0000 UTC m=+794.829562914" watchObservedRunningTime="2026-07-07 14:47:33.034783573 +0000 UTC m=+794.830890780" Jul 07 14:47:33.051110 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:33.051052 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" podStartSLOduration=1.9201355 podStartE2EDuration="5.051027517s" totalImagesPullingTime="3.130892017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:47:33.047734833 +0000 UTC m=+794.843841987" watchObservedRunningTime="2026-07-07 14:47:33.051027517 +0000 UTC m=+794.847134668" Jul 07 14:47:44.024610 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.024534 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:44.024610 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.024599 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cldz6" Jul 07 14:47:44.090300 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.090266 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:44.090536 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.090511 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" podUID="aeee578c-53a9-4d43-92f0-160df3f3703e" containerName="limitador" containerID="cri-o://190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d" gracePeriod=30 Jul 07 14:47:44.650979 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.650921 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:44.800542 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.800506 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file\") pod \"aeee578c-53a9-4d43-92f0-160df3f3703e\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " Jul 07 14:47:44.800770 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.800559 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vpl5\" (UniqueName: \"kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5\") pod \"aeee578c-53a9-4d43-92f0-160df3f3703e\" (UID: \"aeee578c-53a9-4d43-92f0-160df3f3703e\") " Jul 07 14:47:44.800964 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.800939 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file" (OuterVolumeSpecName: "config-file") pod "aeee578c-53a9-4d43-92f0-160df3f3703e" (UID: "aeee578c-53a9-4d43-92f0-160df3f3703e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:47:44.802757 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.802734 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5" (OuterVolumeSpecName: "kube-api-access-5vpl5") pod "aeee578c-53a9-4d43-92f0-160df3f3703e" (UID: "aeee578c-53a9-4d43-92f0-160df3f3703e"). InnerVolumeSpecName "kube-api-access-5vpl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:47:44.901701 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.901578 2590 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aeee578c-53a9-4d43-92f0-160df3f3703e-config-file\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:47:44.901701 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:44.901610 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vpl5\" (UniqueName: \"kubernetes.io/projected/aeee578c-53a9-4d43-92f0-160df3f3703e-kube-api-access-5vpl5\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:47:45.087933 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.087901 2590 generic.go:356] "Generic (PLEG): container finished" podID="aeee578c-53a9-4d43-92f0-160df3f3703e" containerID="190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d" exitCode=0 Jul 07 14:47:45.088363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.087946 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" Jul 07 14:47:45.088363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.087959 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" event={"ID":"aeee578c-53a9-4d43-92f0-160df3f3703e","Type":"ContainerDied","Data":"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d"} Jul 07 14:47:45.088363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.088001 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jt2wc" event={"ID":"aeee578c-53a9-4d43-92f0-160df3f3703e","Type":"ContainerDied","Data":"8472213911ab9cb617af4300bf13a75b8cf752eefae6df24c4ae3244b650a79b"} Jul 07 14:47:45.088363 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.088021 2590 scope.go:117] "RemoveContainer" containerID="190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d" Jul 07 14:47:45.097708 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.097506 2590 scope.go:117] "RemoveContainer" containerID="190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d" Jul 07 14:47:45.097869 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:47:45.097849 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d\": container with ID starting with 190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d not found: ID does not exist" containerID="190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d" Jul 07 14:47:45.097939 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.097883 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d"} err="failed to get container status \"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d\": rpc error: code = NotFound desc = could not find container \"190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d\": container with ID starting with 190061c26e82f0aa7b330e68630c3f9dd24cc003bbd3c8541dd3838e50506c5d not found: ID does not exist" Jul 07 14:47:45.109510 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.109482 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:45.113300 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:45.113277 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jt2wc"] Jul 07 14:47:46.426309 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.426277 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-5smb6"] Jul 07 14:47:46.427035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.426689 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeee578c-53a9-4d43-92f0-160df3f3703e" containerName="limitador" Jul 07 14:47:46.427035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.426704 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeee578c-53a9-4d43-92f0-160df3f3703e" containerName="limitador" Jul 07 14:47:46.427035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.426804 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeee578c-53a9-4d43-92f0-160df3f3703e" containerName="limitador" Jul 07 14:47:46.431405 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.431382 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.433978 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.433955 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 14:47:46.434107 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.433987 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k8cmh\"" Jul 07 14:47:46.440870 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.440840 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5smb6"] Jul 07 14:47:46.516886 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.516842 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctv29\" (UniqueName: \"kubernetes.io/projected/761c38b5-f668-4f85-8380-cd93a0947db7-kube-api-access-ctv29\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.516886 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.516890 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/761c38b5-f668-4f85-8380-cd93a0947db7-data\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.617478 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.617445 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctv29\" (UniqueName: \"kubernetes.io/projected/761c38b5-f668-4f85-8380-cd93a0947db7-kube-api-access-ctv29\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.617478 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.617478 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/761c38b5-f668-4f85-8380-cd93a0947db7-data\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.617871 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.617855 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/761c38b5-f668-4f85-8380-cd93a0947db7-data\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.625840 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.625817 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctv29\" (UniqueName: \"kubernetes.io/projected/761c38b5-f668-4f85-8380-cd93a0947db7-kube-api-access-ctv29\") pod \"postgres-69fb4594cf-5smb6\" (UID: \"761c38b5-f668-4f85-8380-cd93a0947db7\") " pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.666926 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.666893 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeee578c-53a9-4d43-92f0-160df3f3703e" path="/var/lib/kubelet/pods/aeee578c-53a9-4d43-92f0-160df3f3703e/volumes" Jul 07 14:47:46.746604 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.746510 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:46.880201 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:46.880177 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5smb6"] Jul 07 14:47:46.882807 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:47:46.882785 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761c38b5_f668_4f85_8380_cd93a0947db7.slice/crio-6912abf4a25681696095c5f71d5035486954f8eb5e2c7a216ff50557be471fb1 WatchSource:0}: Error finding container 6912abf4a25681696095c5f71d5035486954f8eb5e2c7a216ff50557be471fb1: Status 404 returned error can't find the container with id 6912abf4a25681696095c5f71d5035486954f8eb5e2c7a216ff50557be471fb1 Jul 07 14:47:47.099982 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:47.099897 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5smb6" event={"ID":"761c38b5-f668-4f85-8380-cd93a0947db7","Type":"ContainerStarted","Data":"6912abf4a25681696095c5f71d5035486954f8eb5e2c7a216ff50557be471fb1"} Jul 07 14:47:52.136884 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:52.136838 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5smb6" event={"ID":"761c38b5-f668-4f85-8380-cd93a0947db7","Type":"ContainerStarted","Data":"22c996978f9480673df7e7b0d5c16bdd0880762737d7b20d0dee2c1c450c4305"} Jul 07 14:47:52.137241 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:52.136916 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:52.158068 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:52.158016 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-5smb6" podStartSLOduration=1.465489611 podStartE2EDuration="6.158000564s" totalImagesPullingTime="4.692510953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:47:52.156387586 +0000 UTC m=+813.952494736" watchObservedRunningTime="2026-07-07 14:47:52.158000564 +0000 UTC m=+813.954107714" Jul 07 14:47:58.173240 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.173209 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-5smb6" Jul 07 14:47:58.971691 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.971634 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-mdnh6"] Jul 07 14:47:58.978441 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.978413 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:58.981747 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.981716 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 14:47:58.981918 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.981767 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kwnz2\"" Jul 07 14:47:58.986198 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:58.986173 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-mdnh6"] Jul 07 14:47:59.024896 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.024861 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbctq\" (UniqueName: \"kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.025084 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.024919 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.038471 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.038440 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mdnh6"] Jul 07 14:47:59.038769 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:47:59.038746 2590 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hbctq tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-mdnh6" podUID="09982487-7c26-49a2-9b6d-29959de53e21" Jul 07 14:47:59.125950 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.125904 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.126110 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.126022 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbctq\" (UniqueName: \"kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.128528 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.128488 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.137188 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.137160 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbctq\" (UniqueName: \"kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq\") pod \"authorino-76877994-mdnh6\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.174331 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.174303 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.182873 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.182847 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:47:59.226587 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.226505 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbctq\" (UniqueName: \"kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq\") pod \"09982487-7c26-49a2-9b6d-29959de53e21\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " Jul 07 14:47:59.226769 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.226604 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert\") pod \"09982487-7c26-49a2-9b6d-29959de53e21\" (UID: \"09982487-7c26-49a2-9b6d-29959de53e21\") " Jul 07 14:47:59.228686 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.228658 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq" (OuterVolumeSpecName: "kube-api-access-hbctq") pod "09982487-7c26-49a2-9b6d-29959de53e21" (UID: "09982487-7c26-49a2-9b6d-29959de53e21"). InnerVolumeSpecName "kube-api-access-hbctq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:47:59.228796 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.228744 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "09982487-7c26-49a2-9b6d-29959de53e21" (UID: "09982487-7c26-49a2-9b6d-29959de53e21"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:47:59.327565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.327522 2590 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09982487-7c26-49a2-9b6d-29959de53e21-tls-cert\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:47:59.327565 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:47:59.327553 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbctq\" (UniqueName: \"kubernetes.io/projected/09982487-7c26-49a2-9b6d-29959de53e21-kube-api-access-hbctq\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:48:00.179142 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:00.179112 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mdnh6" Jul 07 14:48:00.210454 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:00.210424 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mdnh6"] Jul 07 14:48:00.213953 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:00.213932 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-mdnh6"] Jul 07 14:48:00.666803 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:00.666755 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09982487-7c26-49a2-9b6d-29959de53e21" path="/var/lib/kubelet/pods/09982487-7c26-49a2-9b6d-29959de53e21/volumes" Jul 07 14:48:40.329717 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.329686 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-d8975"] Jul 07 14:48:40.334532 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.334513 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.338125 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.338100 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sxk76\"" Jul 07 14:48:40.338998 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.338970 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 14:48:40.347965 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.347941 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-d8975"] Jul 07 14:48:40.374866 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.374841 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:48:40.380740 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.380703 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z55bj"] Jul 07 14:48:40.384544 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.384525 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.399934 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.399907 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z55bj"] Jul 07 14:48:40.411458 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.411426 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n22w\" (UniqueName: \"kubernetes.io/projected/7e38f7e8-747d-4358-bfee-c038b319cbda-kube-api-access-4n22w\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.411668 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.411465 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e38f7e8-747d-4358-bfee-c038b319cbda-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.411752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.411669 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mnzm\" (UniqueName: \"kubernetes.io/projected/937652a1-c5eb-4cf3-b48f-15d7b599cae2-kube-api-access-4mnzm\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.411752 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.411726 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/937652a1-c5eb-4cf3-b48f-15d7b599cae2-plugins-config-volume\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.513091 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513057 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/937652a1-c5eb-4cf3-b48f-15d7b599cae2-plugins-config-volume\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.513279 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513122 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n22w\" (UniqueName: \"kubernetes.io/projected/7e38f7e8-747d-4358-bfee-c038b319cbda-kube-api-access-4n22w\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.513279 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513143 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e38f7e8-747d-4358-bfee-c038b319cbda-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.513279 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513187 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mnzm\" (UniqueName: \"kubernetes.io/projected/937652a1-c5eb-4cf3-b48f-15d7b599cae2-kube-api-access-4mnzm\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.513876 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513851 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/937652a1-c5eb-4cf3-b48f-15d7b599cae2-plugins-config-volume\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.513976 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.513914 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e38f7e8-747d-4358-bfee-c038b319cbda-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.522333 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.522303 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mnzm\" (UniqueName: \"kubernetes.io/projected/937652a1-c5eb-4cf3-b48f-15d7b599cae2-kube-api-access-4mnzm\") pod \"payload-processing-58f86c7798-d8975\" (UID: \"937652a1-c5eb-4cf3-b48f-15d7b599cae2\") " pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.522333 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.522325 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n22w\" (UniqueName: \"kubernetes.io/projected/7e38f7e8-747d-4358-bfee-c038b319cbda-kube-api-access-4n22w\") pod \"payload-pre-processing-7964457696-z55bj\" (UID: \"7e38f7e8-747d-4358-bfee-c038b319cbda\") " pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.646046 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.646017 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:40.695802 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.695765 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:40.821759 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.821724 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-d8975"] Jul 07 14:48:40.825021 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:48:40.824979 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937652a1_c5eb_4cf3_b48f_15d7b599cae2.slice/crio-c8126cde23ccf657123d1b2d33446e51028b308ae56be4e906e5c00aaa7f86fe WatchSource:0}: Error finding container c8126cde23ccf657123d1b2d33446e51028b308ae56be4e906e5c00aaa7f86fe: Status 404 returned error can't find the container with id c8126cde23ccf657123d1b2d33446e51028b308ae56be4e906e5c00aaa7f86fe Jul 07 14:48:40.875905 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:40.875881 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z55bj"] Jul 07 14:48:40.878582 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:48:40.878550 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e38f7e8_747d_4358_bfee_c038b319cbda.slice/crio-4c43f272dc907363d9f7709245565c0bbf670e3261e67fb30370e403cfc139a3 WatchSource:0}: Error finding container 4c43f272dc907363d9f7709245565c0bbf670e3261e67fb30370e403cfc139a3: Status 404 returned error can't find the container with id 4c43f272dc907363d9f7709245565c0bbf670e3261e67fb30370e403cfc139a3 Jul 07 14:48:41.399276 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:41.399240 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" event={"ID":"7e38f7e8-747d-4358-bfee-c038b319cbda","Type":"ContainerStarted","Data":"4c43f272dc907363d9f7709245565c0bbf670e3261e67fb30370e403cfc139a3"} Jul 07 14:48:41.400722 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:41.400681 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-d8975" event={"ID":"937652a1-c5eb-4cf3-b48f-15d7b599cae2","Type":"ContainerStarted","Data":"c8126cde23ccf657123d1b2d33446e51028b308ae56be4e906e5c00aaa7f86fe"} Jul 07 14:48:42.407874 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.407838 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" event={"ID":"7e38f7e8-747d-4358-bfee-c038b319cbda","Type":"ContainerStarted","Data":"ed4d0edf337a08b8000de6c20802cddeee42a93a25ff1902dc50c5d99b74de12"} Jul 07 14:48:42.408312 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.407967 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:42.410164 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.410139 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-d8975" event={"ID":"937652a1-c5eb-4cf3-b48f-15d7b599cae2","Type":"ContainerStarted","Data":"3dc8b2c8e03ff4438924f01bfed773f1b6888b6e9cd4acee102f48e95de1a4e3"} Jul 07 14:48:42.410290 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.410252 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:42.427033 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.426982 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" podStartSLOduration=1.013389308 podStartE2EDuration="2.426965245s" totalImagesPullingTime="1.413575937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:48:42.424491902 +0000 UTC m=+864.220599043" watchObservedRunningTime="2026-07-07 14:48:42.426965245 +0000 UTC m=+864.223072396" Jul 07 14:48:42.442725 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:42.442639 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-d8975" podStartSLOduration=0.97323512 podStartE2EDuration="2.442617118s" totalImagesPullingTime="1.469381998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:48:42.440250629 +0000 UTC m=+864.236357780" watchObservedRunningTime="2026-07-07 14:48:42.442617118 +0000 UTC m=+864.238724272" Jul 07 14:48:53.419473 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:53.419443 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-z55bj" Jul 07 14:48:53.419902 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:53.419522 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-d8975" Jul 07 14:48:54.476257 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:48:54.476219 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:49:04.763523 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.763488 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v"] Jul 07 14:49:04.768592 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.768568 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.771080 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.771058 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 14:49:04.771959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.771796 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 14:49:04.771959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.771799 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 14:49:04.771959 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.771802 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qh5dn\"" Jul 07 14:49:04.777315 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.777295 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v"] Jul 07 14:49:04.856640 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856611 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.856753 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856672 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.856795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856757 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948e13c1-2086-47a9-81e1-bc261a2d2f72-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.856795 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856789 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.856932 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856911 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqztg\" (UniqueName: \"kubernetes.io/projected/948e13c1-2086-47a9-81e1-bc261a2d2f72-kube-api-access-hqztg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.856968 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.856950 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957377 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957335 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqztg\" (UniqueName: \"kubernetes.io/projected/948e13c1-2086-47a9-81e1-bc261a2d2f72-kube-api-access-hqztg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957377 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957381 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957421 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957442 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957485 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948e13c1-2086-47a9-81e1-bc261a2d2f72-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957680 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957512 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.957963 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957900 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.958018 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.957963 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.958057 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.958031 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.959799 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.959780 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948e13c1-2086-47a9-81e1-bc261a2d2f72-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.959947 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.959929 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948e13c1-2086-47a9-81e1-bc261a2d2f72-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:04.966297 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:04.966273 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqztg\" (UniqueName: \"kubernetes.io/projected/948e13c1-2086-47a9-81e1-bc261a2d2f72-kube-api-access-hqztg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pzd7v\" (UID: \"948e13c1-2086-47a9-81e1-bc261a2d2f72\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:05.098532 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:05.098439 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:05.246781 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:05.246747 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v"] Jul 07 14:49:05.248479 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:49:05.248446 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948e13c1_2086_47a9_81e1_bc261a2d2f72.slice/crio-2f5b08be14c351eb9ad6755adf43cf8c4bfbd22bc7949dc9c61b953376b930ba WatchSource:0}: Error finding container 2f5b08be14c351eb9ad6755adf43cf8c4bfbd22bc7949dc9c61b953376b930ba: Status 404 returned error can't find the container with id 2f5b08be14c351eb9ad6755adf43cf8c4bfbd22bc7949dc9c61b953376b930ba Jul 07 14:49:05.536232 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:05.536186 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" event={"ID":"948e13c1-2086-47a9-81e1-bc261a2d2f72","Type":"ContainerStarted","Data":"2f5b08be14c351eb9ad6755adf43cf8c4bfbd22bc7949dc9c61b953376b930ba"} Jul 07 14:49:05.564419 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:05.564377 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:49:07.549251 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:07.549209 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" event={"ID":"948e13c1-2086-47a9-81e1-bc261a2d2f72","Type":"ContainerStarted","Data":"ec2c5fd9d6d025cc907428e98421c5809b013188dac401effd497b7858aedc6d"} Jul 07 14:49:07.570868 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:07.570812 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" podStartSLOduration=2.22910802 podStartE2EDuration="3.570791157s" totalImagesPullingTime="1.341683137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:07.569233707 +0000 UTC m=+889.365340857" watchObservedRunningTime="2026-07-07 14:49:07.570791157 +0000 UTC m=+889.366898307" Jul 07 14:49:15.099501 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:15.099463 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:15.100079 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:15.099786 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:15.112497 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:15.112475 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:15.603454 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:15.603419 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pzd7v" Jul 07 14:49:35.971979 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:35.971943 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s"] Jul 07 14:49:35.975501 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:35.975480 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:35.977945 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:35.977921 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 14:49:35.987854 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:35.987826 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s"] Jul 07 14:49:36.064289 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064251 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.064289 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064287 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.064566 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064310 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.064566 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064340 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.064566 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064484 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7j9l\" (UniqueName: \"kubernetes.io/projected/8e4dfc9f-908d-4517-bc37-0a2f42768b14-kube-api-access-v7j9l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.064566 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.064537 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.165863 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.165826 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.165863 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.165865 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.165893 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.165917 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.166005 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7j9l\" (UniqueName: \"kubernetes.io/projected/8e4dfc9f-908d-4517-bc37-0a2f42768b14-kube-api-access-v7j9l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166129 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.166043 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166322 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.166290 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166369 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.166329 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.166441 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.166402 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.168291 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.168268 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e4dfc9f-908d-4517-bc37-0a2f42768b14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.168470 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.168453 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e4dfc9f-908d-4517-bc37-0a2f42768b14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.174861 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.174842 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7j9l\" (UniqueName: \"kubernetes.io/projected/8e4dfc9f-908d-4517-bc37-0a2f42768b14-kube-api-access-v7j9l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sck5s\" (UID: \"8e4dfc9f-908d-4517-bc37-0a2f42768b14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.287690 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.287582 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:36.443208 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.443185 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s"] Jul 07 14:49:36.445604 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:49:36.445571 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4dfc9f_908d_4517_bc37_0a2f42768b14.slice/crio-6d1bb78e853c277ebcd2dbce22ab2c1a069d15bdd57ee4b95d7e66727227d622 WatchSource:0}: Error finding container 6d1bb78e853c277ebcd2dbce22ab2c1a069d15bdd57ee4b95d7e66727227d622: Status 404 returned error can't find the container with id 6d1bb78e853c277ebcd2dbce22ab2c1a069d15bdd57ee4b95d7e66727227d622 Jul 07 14:49:36.447054 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.447036 2590 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:49:36.705694 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.705661 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" event={"ID":"8e4dfc9f-908d-4517-bc37-0a2f42768b14","Type":"ContainerStarted","Data":"718791ec4fd07ed8242220c604b7f34e5760fc36c508a4148312c1b8fbf797f5"} Jul 07 14:49:36.705853 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.705720 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" event={"ID":"8e4dfc9f-908d-4517-bc37-0a2f42768b14","Type":"ContainerStarted","Data":"6d1bb78e853c277ebcd2dbce22ab2c1a069d15bdd57ee4b95d7e66727227d622"} Jul 07 14:49:36.724769 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:36.724716 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" podStartSLOduration=1.534227878 podStartE2EDuration="1.724698648s" totalImagesPullingTime="190.47077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:36.721530973 +0000 UTC m=+918.517638127" watchObservedRunningTime="2026-07-07 14:49:36.724698648 +0000 UTC m=+918.520805798" Jul 07 14:49:41.356722 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:41.356683 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:49:46.288345 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:46.288294 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:46.289038 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:46.288371 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:46.300835 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:46.300808 2590 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:49:46.768676 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:46.768626 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:49:46.773103 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:49:46.773079 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sck5s" Jul 07 14:50:01.059234 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:50:01.059204 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:50:56.566461 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:50:56.566377 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:51:44.176218 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:51:44.176182 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:51:53.277334 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:51:53.277297 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:52:04.679724 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:52:04.679684 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:52:13.717612 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:52:13.717575 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:52:24.279978 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:52:24.279944 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:52:51.380499 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:52:51.380459 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:53:03.470341 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:53:03.470300 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:53:38.274724 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:53:38.274692 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:53:47.999034 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:53:47.998953 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:53:57.179310 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:53:57.179273 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:54:08.173356 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:54:08.173318 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:54:18.398247 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:54:18.398213 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:54:33.378253 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:54:33.378209 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:54:39.769738 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:54:39.769700 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:54:48.775592 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:54:48.775557 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:55:14.173684 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:55:14.173625 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:55:25.372260 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:55:25.372226 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:55:50.381078 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:55:50.381042 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:00.479246 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:00.479210 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:17.450035 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:17.450001 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:26.467281 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:26.467248 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:35.850109 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:35.850078 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:46.871660 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:46.871564 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:56:56.172360 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:56:56.172324 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:57:21.975379 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:21.975342 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:57:21.975932 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:21.975587 2590 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" podUID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" containerName="manager" containerID="cri-o://05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56" gracePeriod=10 Jul 07 14:57:24.845202 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:24.845175 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:57:24.997051 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:24.997015 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume\") pod \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " Jul 07 14:57:24.997241 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:24.997099 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvm2d\" (UniqueName: \"kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d\") pod \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\" (UID: \"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b\") " Jul 07 14:57:24.997404 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:24.997379 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" (UID: "9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:57:24.999093 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:24.999074 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d" (OuterVolumeSpecName: "kube-api-access-hvm2d") pod "9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" (UID: "9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b"). InnerVolumeSpecName "kube-api-access-hvm2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:57:25.098621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.098585 2590 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-extensions-socket-volume\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:57:25.098621 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.098615 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvm2d\" (UniqueName: \"kubernetes.io/projected/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b-kube-api-access-hvm2d\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 14:57:25.260763 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.260636 2590 generic.go:356] "Generic (PLEG): container finished" podID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" containerID="05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56" exitCode=0 Jul 07 14:57:25.260763 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.260692 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" Jul 07 14:57:25.260964 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.260693 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" event={"ID":"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b","Type":"ContainerDied","Data":"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56"} Jul 07 14:57:25.260964 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.260808 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8" event={"ID":"9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b","Type":"ContainerDied","Data":"8070625b715ef47be9eef18c462f8fe39847098b57fb634441fc294c384c9435"} Jul 07 14:57:25.260964 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.260830 2590 scope.go:117] "RemoveContainer" containerID="05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56" Jul 07 14:57:25.275558 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.275537 2590 scope.go:117] "RemoveContainer" containerID="05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56" Jul 07 14:57:25.275860 ip-10-0-131-126 kubenswrapper[2590]: E0707 14:57:25.275839 2590 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56\": container with ID starting with 05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56 not found: ID does not exist" containerID="05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56" Jul 07 14:57:25.275940 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.275868 2590 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56"} err="failed to get container status \"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56\": rpc error: code = NotFound desc = could not find container \"05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56\": container with ID starting with 05ee16a9815d6bd1c69e75cc4f1d315b52238ff19b99729aeaaf254e665e9c56 not found: ID does not exist" Jul 07 14:57:25.286387 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.286350 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:57:25.292485 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:25.292456 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bm4z8"] Jul 07 14:57:26.666613 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:57:26.666576 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" path="/var/lib/kubelet/pods/9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b/volumes" Jul 07 14:58:23.160492 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.160454 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7"] Jul 07 14:58:23.161123 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.161103 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" containerName="manager" Jul 07 14:58:23.161210 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.161126 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" containerName="manager" Jul 07 14:58:23.161272 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.161262 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8bbfff-afa9-4fd4-894c-8b999ebf8f9b" containerName="manager" Jul 07 14:58:23.164718 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.164695 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.167792 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.167770 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vrq7c\"" Jul 07 14:58:23.182613 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.182585 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7"] Jul 07 14:58:23.261582 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.261539 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.261790 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.261594 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlvc\" (UniqueName: \"kubernetes.io/projected/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-kube-api-access-ptlvc\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.362876 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.362834 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.362876 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.362882 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlvc\" (UniqueName: \"kubernetes.io/projected/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-kube-api-access-ptlvc\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.363224 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.363202 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.372743 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.372714 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlvc\" (UniqueName: \"kubernetes.io/projected/fd35562d-bb9a-4b04-9c1c-efcaeccf7005-kube-api-access-ptlvc\") pod \"kuadrant-operator-controller-manager-86878c769f-6x2p7\" (UID: \"fd35562d-bb9a-4b04-9c1c-efcaeccf7005\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.476466 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.476365 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:23.625136 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:23.625104 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7"] Jul 07 14:58:23.626858 ip-10-0-131-126 kubenswrapper[2590]: W0707 14:58:23.626822 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd35562d_bb9a_4b04_9c1c_efcaeccf7005.slice/crio-db4fa810920899fccd76f3c7d90aa5354834bd91f3140af9649d41c895bc5d7f WatchSource:0}: Error finding container db4fa810920899fccd76f3c7d90aa5354834bd91f3140af9649d41c895bc5d7f: Status 404 returned error can't find the container with id db4fa810920899fccd76f3c7d90aa5354834bd91f3140af9649d41c895bc5d7f Jul 07 14:58:24.577325 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:24.577244 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" event={"ID":"fd35562d-bb9a-4b04-9c1c-efcaeccf7005","Type":"ContainerStarted","Data":"241615e0f50d80b86e8ede1cf3e0eb766adbce69d93ae7be989488661714079d"} Jul 07 14:58:24.577807 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:24.577357 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" event={"ID":"fd35562d-bb9a-4b04-9c1c-efcaeccf7005","Type":"ContainerStarted","Data":"db4fa810920899fccd76f3c7d90aa5354834bd91f3140af9649d41c895bc5d7f"} Jul 07 14:58:24.577807 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:24.577380 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:24.606512 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:24.606464 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" podStartSLOduration=1.6064464539999999 podStartE2EDuration="1.606446454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:24.603805983 +0000 UTC m=+1446.399913135" watchObservedRunningTime="2026-07-07 14:58:24.606446454 +0000 UTC m=+1446.402553663" Jul 07 14:58:35.586330 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:35.586292 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6x2p7" Jul 07 14:58:44.370185 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:44.370149 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:58:53.670230 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:58:53.670192 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:08.176140 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:08.176100 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:17.075753 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:17.075719 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:26.471262 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:26.471224 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:33.270265 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:33.270225 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:42.373072 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:42.372988 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 14:59:50.864359 ip-10-0-131-126 kubenswrapper[2590]: I0707 14:59:50.864321 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:02.133848 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:02.133813 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:12.676672 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:12.676615 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:20.407365 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:20.407329 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:28.975385 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:28.975338 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:35.418099 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:35.418062 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:00:56.784098 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:00:56.784063 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:04.976056 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:04.976019 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:15.174838 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:15.174800 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:27.575847 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:27.575811 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:35.982709 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:35.982673 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:47.521051 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:47.521016 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:01:56.972835 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:01:56.972798 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:06.389518 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:06.389482 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:13.763596 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:13.763557 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:24.396585 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:24.396546 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:33.918452 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:33.918407 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:47.500002 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:47.499909 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:02:56.419351 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:02:56.419318 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:03:05.990686 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:03:05.990630 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:03:17.287412 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:03:17.287371 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:03:29.675530 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:03:29.675491 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:03:37.297157 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:03:37.297122 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:03:49.563920 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:03:49.563885 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:04:01.366150 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:04:01.366107 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:04:12.556882 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:04:12.556790 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:04:28.666719 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:04:28.666683 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:04:40.963024 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:04:40.962987 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:05:00.781018 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:05:00.780986 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:05:08.973503 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:05:08.973469 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:06:32.368571 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:06:32.368529 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:06:41.465872 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:06:41.465840 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:06:55.163661 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:06:55.163555 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:07:03.365877 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:07:03.365840 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:07:35.264166 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:07:35.264122 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:07:47.066681 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:07:47.066631 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:07:58.670000 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:07:58.669969 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:08:11.162171 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:08:11.162133 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:08:51.694922 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:08:51.694833 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:09:08.203310 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:09:08.203268 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:09:22.984607 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:09:22.984565 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:10:11.767924 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:10:11.767839 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:10:22.368204 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:10:22.368169 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:10:31.769868 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:10:31.769835 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:10:53.464756 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:10:53.464716 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:11:09.966738 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:11:09.966703 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:11:21.568057 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:11:21.568022 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:11:58.379519 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:11:58.379477 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:12:08.363214 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:12:08.363174 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:12:21.480880 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:12:21.480837 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:12:33.071160 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:12:33.071123 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:12:45.069625 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:12:45.069573 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:12:55.469843 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:12:55.469803 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:13:06.175994 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:13:06.175952 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:13:30.866144 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:13:30.866104 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:13:52.959904 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:13:52.959870 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:14:05.162878 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:14:05.162839 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:14:21.479725 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:14:21.479693 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:14:36.763085 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:14:36.763044 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:14:49.777079 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:14:49.776979 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:15:00.145119 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.145085 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723955-jrnd9"] Jul 07 15:15:00.149012 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.148987 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:00.151244 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.151226 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gjhm4\"" Jul 07 15:15:00.151736 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.151721 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6"] Jul 07 15:15:00.155402 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.155380 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r"] Jul 07 15:15:00.155532 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.155501 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:00.162889 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.160804 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723955-jrnd9"] Jul 07 15:15:00.162889 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.160933 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:00.169708 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.169680 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r"] Jul 07 15:15:00.171942 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.171923 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6"] Jul 07 15:15:00.282427 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.282388 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9w9k\" (UniqueName: \"kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k\") pod \"maas-api-key-cleanup-29723955-jrnd9\" (UID: \"f1166495-28ff-4fcd-b379-b1b6ed089b6c\") " pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:00.282427 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.282428 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwpb\" (UniqueName: \"kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb\") pod \"maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r\" (UID: \"a854eaf1-5be7-481c-8160-dca204cb5ae6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:00.282733 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.282459 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwbh\" (UniqueName: \"kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh\") pod \"maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6\" (UID: \"06ff1337-32e8-4d75-9933-5df93f5303f4\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:00.383719 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.383676 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9w9k\" (UniqueName: \"kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k\") pod \"maas-api-key-cleanup-29723955-jrnd9\" (UID: \"f1166495-28ff-4fcd-b379-b1b6ed089b6c\") " pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:00.383719 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.383719 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwpb\" (UniqueName: \"kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb\") pod \"maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r\" (UID: \"a854eaf1-5be7-481c-8160-dca204cb5ae6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:00.383990 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.383751 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwbh\" (UniqueName: \"kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh\") pod \"maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6\" (UID: \"06ff1337-32e8-4d75-9933-5df93f5303f4\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:00.392935 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.392911 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9w9k\" (UniqueName: \"kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k\") pod \"maas-api-key-cleanup-29723955-jrnd9\" (UID: \"f1166495-28ff-4fcd-b379-b1b6ed089b6c\") " pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:00.393055 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.392960 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwpb\" (UniqueName: \"kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb\") pod \"maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r\" (UID: \"a854eaf1-5be7-481c-8160-dca204cb5ae6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:00.393055 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.393021 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwbh\" (UniqueName: \"kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh\") pod \"maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6\" (UID: \"06ff1337-32e8-4d75-9933-5df93f5303f4\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:00.470055 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.470024 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:00.483302 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.483263 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:00.492573 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.492545 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:00.641664 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.641619 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723955-jrnd9"] Jul 07 15:15:00.643393 ip-10-0-131-126 kubenswrapper[2590]: W0707 15:15:00.643363 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1166495_28ff_4fcd_b379_b1b6ed089b6c.slice/crio-f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f WatchSource:0}: Error finding container f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f: Status 404 returned error can't find the container with id f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f Jul 07 15:15:00.647371 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.647337 2590 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:15:00.676910 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.676886 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6"] Jul 07 15:15:00.679907 ip-10-0-131-126 kubenswrapper[2590]: W0707 15:15:00.679880 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ff1337_32e8_4d75_9933_5df93f5303f4.slice/crio-2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b WatchSource:0}: Error finding container 2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b: Status 404 returned error can't find the container with id 2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b Jul 07 15:15:00.699236 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:00.699213 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r"] Jul 07 15:15:00.701206 ip-10-0-131-126 kubenswrapper[2590]: W0707 15:15:00.701171 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda854eaf1_5be7_481c_8160_dca204cb5ae6.slice/crio-96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473 WatchSource:0}: Error finding container 96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473: Status 404 returned error can't find the container with id 96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473 Jul 07 15:15:01.048386 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:01.048352 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" event={"ID":"f1166495-28ff-4fcd-b379-b1b6ed089b6c","Type":"ContainerStarted","Data":"f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f"} Jul 07 15:15:01.049466 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:01.049443 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" event={"ID":"a854eaf1-5be7-481c-8160-dca204cb5ae6","Type":"ContainerStarted","Data":"96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473"} Jul 07 15:15:01.050474 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:01.050453 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" event={"ID":"06ff1337-32e8-4d75-9933-5df93f5303f4","Type":"ContainerStarted","Data":"2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b"} Jul 07 15:15:04.071209 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.071172 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" event={"ID":"f1166495-28ff-4fcd-b379-b1b6ed089b6c","Type":"ContainerStarted","Data":"2bda229a1e5947cd9cf1fa361dfbad8d5277c4a835aa9cd0543eb163a92d50e5"} Jul 07 15:15:04.072737 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.072717 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" event={"ID":"a854eaf1-5be7-481c-8160-dca204cb5ae6","Type":"ContainerStarted","Data":"5dd3c5aee61f74f90193c345276d6fb0aced8136ed079c3625a3a81ec2352761"} Jul 07 15:15:04.074088 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.074064 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" event={"ID":"06ff1337-32e8-4d75-9933-5df93f5303f4","Type":"ContainerStarted","Data":"6e765837fd7644c70dca61d9c526a97ef9d32af3c11e932a4f8af5a286e90dbe"} Jul 07 15:15:04.089080 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.089039 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" podStartSLOduration=1.5614963039999998 podStartE2EDuration="4.089024035s" totalImagesPullingTime="2.527527731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:15:04.088241013 +0000 UTC m=+2445.884348163" watchObservedRunningTime="2026-07-07 15:15:04.089024035 +0000 UTC m=+2445.885131189" Jul 07 15:15:04.105707 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.105626 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" podStartSLOduration=1.68022013 podStartE2EDuration="4.105611092s" totalImagesPullingTime="2.425390962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:15:04.103891301 +0000 UTC m=+2445.899998446" watchObservedRunningTime="2026-07-07 15:15:04.105611092 +0000 UTC m=+2445.901718242" Jul 07 15:15:04.121082 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:04.121037 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" podStartSLOduration=1.6222345630000001 podStartE2EDuration="4.121020619s" totalImagesPullingTime="2.498786056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:15:04.119159823 +0000 UTC m=+2445.915266972" watchObservedRunningTime="2026-07-07 15:15:04.121020619 +0000 UTC m=+2445.917127815" Jul 07 15:15:05.081041 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.081005 2590 generic.go:356] "Generic (PLEG): container finished" podID="f1166495-28ff-4fcd-b379-b1b6ed089b6c" containerID="2bda229a1e5947cd9cf1fa361dfbad8d5277c4a835aa9cd0543eb163a92d50e5" exitCode=0 Jul 07 15:15:05.081471 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.081094 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" event={"ID":"f1166495-28ff-4fcd-b379-b1b6ed089b6c","Type":"ContainerDied","Data":"2bda229a1e5947cd9cf1fa361dfbad8d5277c4a835aa9cd0543eb163a92d50e5"} Jul 07 15:15:05.082583 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.082558 2590 generic.go:356] "Generic (PLEG): container finished" podID="a854eaf1-5be7-481c-8160-dca204cb5ae6" containerID="5dd3c5aee61f74f90193c345276d6fb0aced8136ed079c3625a3a81ec2352761" exitCode=0 Jul 07 15:15:05.082717 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.082662 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" event={"ID":"a854eaf1-5be7-481c-8160-dca204cb5ae6","Type":"ContainerDied","Data":"5dd3c5aee61f74f90193c345276d6fb0aced8136ed079c3625a3a81ec2352761"} Jul 07 15:15:05.084132 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.084114 2590 generic.go:356] "Generic (PLEG): container finished" podID="06ff1337-32e8-4d75-9933-5df93f5303f4" containerID="6e765837fd7644c70dca61d9c526a97ef9d32af3c11e932a4f8af5a286e90dbe" exitCode=0 Jul 07 15:15:05.084220 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:05.084182 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" event={"ID":"06ff1337-32e8-4d75-9933-5df93f5303f4","Type":"ContainerDied","Data":"6e765837fd7644c70dca61d9c526a97ef9d32af3c11e932a4f8af5a286e90dbe"} Jul 07 15:15:06.262255 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.262226 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:06.298458 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.298432 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:06.303847 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.303815 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:06.442675 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.442600 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jwpb\" (UniqueName: \"kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb\") pod \"a854eaf1-5be7-481c-8160-dca204cb5ae6\" (UID: \"a854eaf1-5be7-481c-8160-dca204cb5ae6\") " Jul 07 15:15:06.442841 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.442722 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9w9k\" (UniqueName: \"kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k\") pod \"f1166495-28ff-4fcd-b379-b1b6ed089b6c\" (UID: \"f1166495-28ff-4fcd-b379-b1b6ed089b6c\") " Jul 07 15:15:06.442841 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.442829 2590 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwwbh\" (UniqueName: \"kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh\") pod \"06ff1337-32e8-4d75-9933-5df93f5303f4\" (UID: \"06ff1337-32e8-4d75-9933-5df93f5303f4\") " Jul 07 15:15:06.444958 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.444931 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k" (OuterVolumeSpecName: "kube-api-access-k9w9k") pod "f1166495-28ff-4fcd-b379-b1b6ed089b6c" (UID: "f1166495-28ff-4fcd-b379-b1b6ed089b6c"). InnerVolumeSpecName "kube-api-access-k9w9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:15:06.444958 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.444943 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb" (OuterVolumeSpecName: "kube-api-access-2jwpb") pod "a854eaf1-5be7-481c-8160-dca204cb5ae6" (UID: "a854eaf1-5be7-481c-8160-dca204cb5ae6"). InnerVolumeSpecName "kube-api-access-2jwpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:15:06.445107 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.444943 2590 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh" (OuterVolumeSpecName: "kube-api-access-lwwbh") pod "06ff1337-32e8-4d75-9933-5df93f5303f4" (UID: "06ff1337-32e8-4d75-9933-5df93f5303f4"). InnerVolumeSpecName "kube-api-access-lwwbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:15:06.543962 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.543924 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwwbh\" (UniqueName: \"kubernetes.io/projected/06ff1337-32e8-4d75-9933-5df93f5303f4-kube-api-access-lwwbh\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 15:15:06.543962 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.543954 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jwpb\" (UniqueName: \"kubernetes.io/projected/a854eaf1-5be7-481c-8160-dca204cb5ae6-kube-api-access-2jwpb\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 15:15:06.543962 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:06.543963 2590 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9w9k\" (UniqueName: \"kubernetes.io/projected/f1166495-28ff-4fcd-b379-b1b6ed089b6c-kube-api-access-k9w9k\") on node \"ip-10-0-131-126.ec2.internal\" DevicePath \"\"" Jul 07 15:15:07.096021 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.095988 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" Jul 07 15:15:07.096234 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.096022 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6" event={"ID":"06ff1337-32e8-4d75-9933-5df93f5303f4","Type":"ContainerDied","Data":"2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b"} Jul 07 15:15:07.096234 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.096065 2590 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2aa5f4be36140d9daad10a8d84176705fb36b8cd14eb646f691c7094ea8fbd0b" Jul 07 15:15:07.097567 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.097543 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" Jul 07 15:15:07.097567 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.097558 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723955-jrnd9" event={"ID":"f1166495-28ff-4fcd-b379-b1b6ed089b6c","Type":"ContainerDied","Data":"f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f"} Jul 07 15:15:07.097765 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.097592 2590 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8c7f93ede0833190860572cc9fa4282d492672118a49422becd83792fd6503f" Jul 07 15:15:07.098900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.098886 2590 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" Jul 07 15:15:07.098993 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.098886 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r" event={"ID":"a854eaf1-5be7-481c-8160-dca204cb5ae6","Type":"ContainerDied","Data":"96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473"} Jul 07 15:15:07.098993 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:07.098989 2590 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96d13cfc17b5a03c3de4156109f9a876c57605fa85d1b506e5173904b4e17473" Jul 07 15:15:08.183180 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:08.183139 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:15:22.064781 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:22.064742 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:15:38.769674 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:38.769614 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:15:56.471016 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:15:56.470981 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:16:13.272342 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:16:13.272295 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:16:32.577266 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:16:32.577232 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:16:51.472065 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:16:51.472025 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:17:06.689472 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:17:06.689434 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:17:20.972129 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:17:20.972099 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:17:49.478844 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:17:49.478764 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:18:04.370715 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:04.370679 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:18:14.104609 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:14.104570 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r"] Jul 07 15:18:14.108242 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:14.108207 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-96d90d-29723955-vp56r"] Jul 07 15:18:14.666413 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:14.666377 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a854eaf1-5be7-481c-8160-dca204cb5ae6" path="/var/lib/kubelet/pods/a854eaf1-5be7-481c-8160-dca204cb5ae6/volumes" Jul 07 15:18:18.457868 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:18.457835 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:18:57.059056 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:57.059021 2590 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6"] Jul 07 15:18:57.061188 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:57.061165 2590 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-17f250-29723955-cm6c6"] Jul 07 15:18:58.667121 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:58.667085 2590 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ff1337-32e8-4d75-9933-5df93f5303f4" path="/var/lib/kubelet/pods/06ff1337-32e8-4d75-9933-5df93f5303f4/volumes" Jul 07 15:18:59.667356 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:18:59.667320 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cldz6"] Jul 07 15:19:08.727781 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:08.727750 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jtmkn_75b525ed-a214-4eb0-a268-8d1ee9121d56/manager/0.log" Jul 07 15:19:08.851249 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:08.851219 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7jqj4_ecd1e04a-0369-4532-82ef-e8e4cc03d1e0/manager/0.log" Jul 07 15:19:09.217547 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:09.217518 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723955-jrnd9_f1166495-28ff-4fcd-b379-b1b6ed089b6c/cleanup/0.log" Jul 07 15:19:09.689729 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:09.689701 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655bb48ff6-n5gz5_c77a2397-f474-4b5a-8222-e522aebe350e/copy-manifests/0.log" Jul 07 15:19:09.703787 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:09.703756 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655bb48ff6-n5gz5_c77a2397-f474-4b5a-8222-e522aebe350e/manager/0.log" Jul 07 15:19:10.066375 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:10.066294 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5smb6_761c38b5-f668-4f85-8380-cd93a0947db7/postgres/0.log" Jul 07 15:19:11.515182 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:11.515152 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rf2bh_31ccd219-37a3-495e-989d-07c0a2c8e402/manager/0.log" Jul 07 15:19:11.637363 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:11.637336 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4k4h2_9df194a6-7841-4312-b103-b2134651cf5b/manager/0.log" Jul 07 15:19:11.766946 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:11.766865 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6rvqr_d8c41a65-2bd6-437d-bd69-792370697365/kuadrant-console-plugin/0.log" Jul 07 15:19:11.899274 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:11.899243 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjn27_301e649f-9457-4535-b69b-1abf1ea31d3f/registry-server/0.log" Jul 07 15:19:12.030033 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:12.029959 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6x2p7_fd35562d-bb9a-4b04-9c1c-efcaeccf7005/manager/0.log" Jul 07 15:19:12.150764 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:12.150738 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cldz6_2273c35a-8e22-4bd2-8ec0-29dbce0317cb/limitador/0.log" Jul 07 15:19:12.277832 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:12.277803 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k7dsd_5a487598-ee41-45cb-b3a6-b2eee5974cc6/manager/0.log" Jul 07 15:19:12.885509 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:12.885480 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f6b8bcfd-tcjnh_0ca24172-76b6-4618-8097-a66c0fe61b3d/kube-auth-proxy/0.log" Jul 07 15:19:13.251181 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:13.251146 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z55bj_7e38f7e8-747d-4358-bfee-c038b319cbda/payload-pre-processing/0.log" Jul 07 15:19:13.369544 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:13.369504 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-d8975_937652a1-c5eb-4cf3-b48f-15d7b599cae2/payload-processing/0.log" Jul 07 15:19:13.952569 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:13.952532 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pzd7v_948e13c1-2086-47a9-81e1-bc261a2d2f72/main/0.log" Jul 07 15:19:14.064375 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:14.064340 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sck5s_8e4dfc9f-908d-4517-bc37-0a2f42768b14/main/0.log" Jul 07 15:19:21.679925 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:21.679895 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lbjrz_78a88ab8-8271-4896-8c6b-3a7492211865/global-pull-secret-syncer/0.log" Jul 07 15:19:21.833019 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:21.832989 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zs8m6_023a760b-274f-4be4-8133-bdae9e319beb/konnectivity-agent/0.log" Jul 07 15:19:21.854043 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:21.854013 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-126.ec2.internal_a9496e6239949feac3069ae863246fd9/haproxy/0.log" Jul 07 15:19:26.779894 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:26.779858 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rf2bh_31ccd219-37a3-495e-989d-07c0a2c8e402/manager/0.log" Jul 07 15:19:26.805640 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:26.805612 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4k4h2_9df194a6-7841-4312-b103-b2134651cf5b/manager/0.log" Jul 07 15:19:26.833371 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:26.833348 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6rvqr_d8c41a65-2bd6-437d-bd69-792370697365/kuadrant-console-plugin/0.log" Jul 07 15:19:26.873207 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:26.873163 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjn27_301e649f-9457-4535-b69b-1abf1ea31d3f/registry-server/0.log" Jul 07 15:19:26.994991 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:26.994957 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6x2p7_fd35562d-bb9a-4b04-9c1c-efcaeccf7005/manager/0.log" Jul 07 15:19:27.054676 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:27.054577 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cldz6_2273c35a-8e22-4bd2-8ec0-29dbce0317cb/limitador/0.log" Jul 07 15:19:27.119823 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:27.119796 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-k7dsd_5a487598-ee41-45cb-b3a6-b2eee5974cc6/manager/0.log" Jul 07 15:19:28.718380 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.718353 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/alertmanager/0.log" Jul 07 15:19:28.744302 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.744276 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/config-reloader/0.log" Jul 07 15:19:28.772671 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.772625 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/kube-rbac-proxy-web/0.log" Jul 07 15:19:28.799419 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.799394 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/kube-rbac-proxy/0.log" Jul 07 15:19:28.857018 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.856986 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/kube-rbac-proxy-metric/0.log" Jul 07 15:19:28.917225 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.917197 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/prom-label-proxy/0.log" Jul 07 15:19:28.983410 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:28.983380 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96419f78-9ea6-4e78-8a52-01aee1ea2e2c/init-config-reloader/0.log" Jul 07 15:19:29.208055 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.207969 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84fd77d844-jgxc8_fff1dcbe-b9d1-4414-9220-a5ac2690ecc1/metrics-server/0.log" Jul 07 15:19:29.235955 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.235927 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rhndr_de18ace7-77cc-4dee-a02b-b306e25fc202/monitoring-plugin/0.log" Jul 07 15:19:29.277223 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.277197 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bmnv_df9be8cf-9a18-44ce-89c5-338c0dbb0005/node-exporter/0.log" Jul 07 15:19:29.294784 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.294756 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bmnv_df9be8cf-9a18-44ce-89c5-338c0dbb0005/kube-rbac-proxy/0.log" Jul 07 15:19:29.319304 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.319279 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4bmnv_df9be8cf-9a18-44ce-89c5-338c0dbb0005/init-textfile/0.log" Jul 07 15:19:29.809586 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.809559 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-8d9pf_f383002f-16cd-4743-b081-f6f1f98c5131/prometheus-operator/0.log" Jul 07 15:19:29.829837 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.829807 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-8d9pf_f383002f-16cd-4743-b081-f6f1f98c5131/kube-rbac-proxy/0.log" Jul 07 15:19:29.855407 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.855387 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-f7p6g_6bd1caf1-082b-43aa-95af-b63623077897/prometheus-operator-admission-webhook/0.log" Jul 07 15:19:29.893440 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.893400 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848c5cbcd4-kjtbg_e967e785-161d-43ab-a4fa-3f0534987b45/telemeter-client/0.log" Jul 07 15:19:29.916379 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.916346 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848c5cbcd4-kjtbg_e967e785-161d-43ab-a4fa-3f0534987b45/reload/0.log" Jul 07 15:19:29.937582 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.937553 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848c5cbcd4-kjtbg_e967e785-161d-43ab-a4fa-3f0534987b45/kube-rbac-proxy/0.log" Jul 07 15:19:29.966304 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.966275 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/thanos-query/0.log" Jul 07 15:19:29.986957 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:29.986929 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/kube-rbac-proxy-web/0.log" Jul 07 15:19:30.009072 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:30.009051 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/kube-rbac-proxy/0.log" Jul 07 15:19:30.032883 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:30.032856 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/prom-label-proxy/0.log" Jul 07 15:19:30.054985 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:30.054959 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/kube-rbac-proxy-rules/0.log" Jul 07 15:19:30.076087 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:30.076023 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cdc6cbc4d-89wzr_e7e3d4af-fa4b-4f84-8b0a-1dab97a7702b/kube-rbac-proxy-metrics/0.log" Jul 07 15:19:31.146721 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.146691 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-grhjw_db876ecd-081d-434e-b450-3255e528a2c7/networking-console-plugin/0.log" Jul 07 15:19:31.398114 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398025 2590 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq"] Jul 07 15:19:31.398562 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398543 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ff1337-32e8-4d75-9933-5df93f5303f4" containerName="cleanup" Jul 07 15:19:31.398562 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398560 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ff1337-32e8-4d75-9933-5df93f5303f4" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398582 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a854eaf1-5be7-481c-8160-dca204cb5ae6" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398587 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="a854eaf1-5be7-481c-8160-dca204cb5ae6" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398596 2590 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1166495-28ff-4fcd-b379-b1b6ed089b6c" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398604 2590 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1166495-28ff-4fcd-b379-b1b6ed089b6c" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398715 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ff1337-32e8-4d75-9933-5df93f5303f4" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398729 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1166495-28ff-4fcd-b379-b1b6ed089b6c" containerName="cleanup" Jul 07 15:19:31.398900 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.398739 2590 memory_manager.go:368] "RemoveStaleState removing state" podUID="a854eaf1-5be7-481c-8160-dca204cb5ae6" containerName="cleanup" Jul 07 15:19:31.402093 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.402074 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.404556 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.404531 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-psm49\"/\"kube-root-ca.crt\"" Jul 07 15:19:31.404693 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.404531 2590 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-psm49\"/\"openshift-service-ca.crt\"" Jul 07 15:19:31.404693 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.404619 2590 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-psm49\"/\"default-dockercfg-rg4cq\"" Jul 07 15:19:31.413083 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.413056 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq"] Jul 07 15:19:31.468682 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.468637 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-podres\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.468682 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.468697 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-sys\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.468924 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.468735 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jzhl\" (UniqueName: \"kubernetes.io/projected/075c7b33-f953-432b-8684-c7bf9e5c488a-kube-api-access-4jzhl\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.468924 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.468752 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-proc\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.468924 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.468806 2590 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-lib-modules\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.569885 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.569846 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-podres\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.569900 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-sys\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.569932 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jzhl\" (UniqueName: \"kubernetes.io/projected/075c7b33-f953-432b-8684-c7bf9e5c488a-kube-api-access-4jzhl\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.569950 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-proc\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.569978 2590 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-lib-modules\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.570019 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-podres\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.570030 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-sys\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570101 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.570064 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-proc\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.570437 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.570115 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/075c7b33-f953-432b-8684-c7bf9e5c488a-lib-modules\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.578593 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.578565 2590 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jzhl\" (UniqueName: \"kubernetes.io/projected/075c7b33-f953-432b-8684-c7bf9e5c488a-kube-api-access-4jzhl\") pod \"perf-node-gather-daemonset-lm6dq\" (UID: \"075c7b33-f953-432b-8684-c7bf9e5c488a\") " pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.713263 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.713172 2590 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:31.857352 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:31.857325 2590 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq"] Jul 07 15:19:31.859851 ip-10-0-131-126 kubenswrapper[2590]: W0707 15:19:31.859821 2590 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod075c7b33_f953_432b_8684_c7bf9e5c488a.slice/crio-a8ea78614ee3dcf6dc7555f51cdb42bd6ab811b3e3f831089875b825f95438fe WatchSource:0}: Error finding container a8ea78614ee3dcf6dc7555f51cdb42bd6ab811b3e3f831089875b825f95438fe: Status 404 returned error can't find the container with id a8ea78614ee3dcf6dc7555f51cdb42bd6ab811b3e3f831089875b825f95438fe Jul 07 15:19:32.285750 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.285673 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-667c5759f-5dwz7_8bfb42f1-759c-48e5-82a3-87e684cd56a6/console/0.log" Jul 07 15:19:32.317353 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.317321 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-nnb5d_81b6b607-d3d4-42b8-9c45-328dacccd584/download-server/0.log" Jul 07 15:19:32.596384 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.596250 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" event={"ID":"075c7b33-f953-432b-8684-c7bf9e5c488a","Type":"ContainerStarted","Data":"dd3f945323c4afd4138c5c0d6123f9bbd7e0ddf4edcd23d337a9a4a2c7db8a30"} Jul 07 15:19:32.596384 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.596320 2590 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" event={"ID":"075c7b33-f953-432b-8684-c7bf9e5c488a","Type":"ContainerStarted","Data":"a8ea78614ee3dcf6dc7555f51cdb42bd6ab811b3e3f831089875b825f95438fe"} Jul 07 15:19:32.596638 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.596517 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:32.615248 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:32.615194 2590 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" podStartSLOduration=1.615177107 podStartE2EDuration="1.615177107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:19:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:19:32.614096211 +0000 UTC m=+2714.410203363" watchObservedRunningTime="2026-07-07 15:19:32.615177107 +0000 UTC m=+2714.411284258" Jul 07 15:19:33.924420 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:33.924390 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p8prz_d67dc065-ea58-4e03-966b-ccaaa5283db9/dns/0.log" Jul 07 15:19:33.949794 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:33.949767 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p8prz_d67dc065-ea58-4e03-966b-ccaaa5283db9/kube-rbac-proxy/0.log" Jul 07 15:19:34.075535 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:34.075504 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdmlz_908f7ea3-b315-4a93-a41c-c60d7706443e/dns-node-resolver/0.log" Jul 07 15:19:34.642820 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:34.642791 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rw669_673bf5f2-ed78-40e4-85e6-abd6fd0ec7ee/node-ca/0.log" Jul 07 15:19:35.815569 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:35.815529 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f6b8bcfd-tcjnh_0ca24172-76b6-4618-8097-a66c0fe61b3d/kube-auth-proxy/0.log" Jul 07 15:19:35.941177 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:35.941148 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z55bj_7e38f7e8-747d-4358-bfee-c038b319cbda/payload-pre-processing/0.log" Jul 07 15:19:35.993769 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:35.993743 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-d8975_937652a1-c5eb-4cf3-b48f-15d7b599cae2/payload-processing/0.log" Jul 07 15:19:36.717272 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:36.717242 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cs9m4_0fbea0de-dc74-41db-be92-cd573ec92d65/serve-healthcheck-canary/0.log" Jul 07 15:19:37.225041 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:37.225009 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7bw74_58dd583e-e59a-4ea7-8a11-4ded2195a28e/insights-operator/0.log" Jul 07 15:19:37.225433 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:37.225419 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7bw74_58dd583e-e59a-4ea7-8a11-4ded2195a28e/insights-operator/1.log" Jul 07 15:19:37.250013 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:37.249988 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kjct_4d5b60d6-5b71-40cf-a0da-5f6d3fece667/kube-rbac-proxy/0.log" Jul 07 15:19:37.274328 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:37.274303 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kjct_4d5b60d6-5b71-40cf-a0da-5f6d3fece667/exporter/0.log" Jul 07 15:19:37.298147 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:37.298123 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kjct_4d5b60d6-5b71-40cf-a0da-5f6d3fece667/extractor/0.log" Jul 07 15:19:38.613078 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:38.613052 2590 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-psm49/perf-node-gather-daemonset-lm6dq" Jul 07 15:19:39.500754 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:39.500728 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jtmkn_75b525ed-a214-4eb0-a268-8d1ee9121d56/manager/0.log" Jul 07 15:19:39.625571 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:39.625542 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7jqj4_ecd1e04a-0369-4532-82ef-e8e4cc03d1e0/manager/0.log" Jul 07 15:19:39.729699 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:39.729673 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723955-jrnd9_f1166495-28ff-4fcd-b379-b1b6ed089b6c/cleanup/0.log" Jul 07 15:19:40.023454 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:40.023420 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655bb48ff6-n5gz5_c77a2397-f474-4b5a-8222-e522aebe350e/manager/0.log" Jul 07 15:19:40.042528 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:40.042503 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655bb48ff6-n5gz5_c77a2397-f474-4b5a-8222-e522aebe350e/copy-manifests/0.log" Jul 07 15:19:40.176588 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:40.176557 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5smb6_761c38b5-f668-4f85-8380-cd93a0947db7/postgres/0.log" Jul 07 15:19:41.187172 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:41.187144 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f6b8bcfd-tcjnh_0ca24172-76b6-4618-8097-a66c0fe61b3d/kube-auth-proxy/0.log" Jul 07 15:19:41.289015 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:41.288988 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z55bj_7e38f7e8-747d-4358-bfee-c038b319cbda/payload-pre-processing/0.log" Jul 07 15:19:41.324879 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:41.324840 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-d8975_937652a1-c5eb-4cf3-b48f-15d7b599cae2/payload-processing/0.log" Jul 07 15:19:42.787190 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:42.787157 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f6b8bcfd-tcjnh_0ca24172-76b6-4618-8097-a66c0fe61b3d/kube-auth-proxy/0.log" Jul 07 15:19:42.877705 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:42.877628 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z55bj_7e38f7e8-747d-4358-bfee-c038b319cbda/payload-pre-processing/0.log" Jul 07 15:19:42.915568 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:42.915538 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-d8975_937652a1-c5eb-4cf3-b48f-15d7b599cae2/payload-processing/0.log" Jul 07 15:19:46.575733 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:46.575705 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-tq6nh_976e325e-8808-46de-ac37-692630d153ca/migrator/0.log" Jul 07 15:19:46.598729 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:46.598696 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-tq6nh_976e325e-8808-46de-ac37-692630d153ca/graceful-termination/0.log" Jul 07 15:19:47.896790 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.896759 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/kube-multus-additional-cni-plugins/0.log" Jul 07 15:19:47.917555 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.917531 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/egress-router-binary-copy/0.log" Jul 07 15:19:47.937075 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.937053 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/cni-plugins/0.log" Jul 07 15:19:47.958037 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.958006 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/bond-cni-plugin/0.log" Jul 07 15:19:47.977420 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.977403 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/routeoverride-cni/0.log" Jul 07 15:19:47.997081 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:47.997055 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/whereabouts-cni-bincopy/0.log" Jul 07 15:19:48.017006 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:48.016985 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8svzx_aceb0b20-1ac5-42a6-8fb2-9e478d9325e5/whereabouts-cni/0.log" Jul 07 15:19:48.428299 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:48.428272 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mgd5f_938c6c98-a2ca-477c-b313-a77ada5bc7d2/kube-multus/0.log" Jul 07 15:19:48.448601 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:48.448578 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cbmr8_4dc76eb3-2ae2-4d44-bb57-55964b190580/network-metrics-daemon/0.log" Jul 07 15:19:48.468105 ip-10-0-131-126 kubenswrapper[2590]: I0707 15:19:48.468081 2590 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cbmr8_4dc76eb3-2ae2-4d44-bb57-55964b190580/kube-rbac-proxy/0.log"