Jul 06 19:21:30.726074 ip-10-0-143-242 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 19:21:30.726087 ip-10-0-143-242 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 19:21:30.726097 ip-10-0-143-242 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 19:21:30.726441 ip-10-0-143-242 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 19:21:40.854391 ip-10-0-143-242 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 19:21:40.854408 ip-10-0-143-242 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ca667cc5685148ca90ec714985754260 -- Jul 06 19:23:16.296436 ip-10-0-143-242 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.754294 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759328 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759347 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759351 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759355 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759358 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759361 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759364 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:16.762077 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759367 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759370 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759373 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759375 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759378 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759381 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759393 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759402 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759405 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759408 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759410 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759413 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759417 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759421 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759423 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759426 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759428 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759431 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:16.777072 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759436 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759440 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759443 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759446 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759449 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759452 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759455 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759457 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759460 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759463 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759466 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759469 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759471 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759474 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759477 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759480 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759482 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759485 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759487 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759490 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:16.778855 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759492 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759496 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759504 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759506 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759509 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759511 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759514 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759516 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759519 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759521 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759524 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759526 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759529 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759532 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759535 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759537 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759541 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759544 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759546 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759549 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:16.781169 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759552 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759556 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759561 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759564 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759567 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759570 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759572 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759575 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759577 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759580 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759583 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759586 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759588 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759591 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759593 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759598 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759603 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759606 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759608 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:16.792612 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759611 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759614 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759617 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759620 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759623 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759625 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759628 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759630 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759633 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759637 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759640 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759642 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759645 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.759648 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760415 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760422 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760425 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760429 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760432 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760435 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:16.795018 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760437 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760440 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760443 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760445 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760448 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760451 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760454 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760457 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760459 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760462 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760465 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760468 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760471 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760474 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760478 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760482 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760485 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760489 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760492 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760495 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:16.796920 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760498 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760501 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760504 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760507 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760510 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760512 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760516 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760519 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760522 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760525 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760527 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760530 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760534 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760538 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760541 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760543 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760546 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760549 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760552 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760554 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:16.799178 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760557 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760561 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760564 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760568 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760571 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760574 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760577 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760580 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760584 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760587 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760589 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760592 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760595 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760598 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760601 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760603 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760606 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760608 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760611 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:16.812635 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760613 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760616 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760619 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760622 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760625 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760628 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760630 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760633 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760635 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760638 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760641 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760643 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760646 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760649 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760651 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760654 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760657 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760660 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760662 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:16.815048 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760665 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760667 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760670 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760674 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760677 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760680 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760683 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760686 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760688 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760691 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760697 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760700 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760703 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760705 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.760708 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761230 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761239 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761243 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761247 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761250 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:16.816784 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761253 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761256 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761260 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761262 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761265 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761268 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761272 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761274 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761277 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761280 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761284 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761288 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761291 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761294 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761296 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761299 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761301 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761304 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761307 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761309 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:16.833022 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761312 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761315 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761320 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761323 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761325 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761328 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761330 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761334 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761346 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761349 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761352 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761354 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761357 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761360 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761364 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761367 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761370 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761373 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761375 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761378 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:16.835081 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761381 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:16.834836 ip-10-0-143-242 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761384 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761387 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761390 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761392 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761395 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761397 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761400 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761403 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761405 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761408 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761410 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761413 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761416 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761420 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761422 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761425 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761427 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761430 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761433 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:16.849328 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761436 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761438 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761441 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761444 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761447 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761450 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761453 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761455 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761458 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761461 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761463 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761466 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761468 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761471 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761474 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761477 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761481 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761485 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761488 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:16.865705 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761491 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761494 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761497 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761500 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761504 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761508 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761511 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761516 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761518 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761521 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761524 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761526 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761529 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761531 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.761534 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761612 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761623 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761632 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761639 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761645 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:23:16.868416 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761649 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761653 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761658 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761661 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761664 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761668 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761671 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761674 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761677 2558 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761681 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761685 2558 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761688 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761691 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761695 2558 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761698 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761701 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761704 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761710 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761713 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761718 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761721 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761724 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761727 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761730 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:23:16.870372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761733 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761736 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761739 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761744 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761747 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761751 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761755 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761760 2558 flags.go:64] FLAG: --enable-server="true" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761764 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761770 2558 flags.go:64] FLAG: --event-burst="100" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761773 2558 flags.go:64] FLAG: --event-qps="50" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761776 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761779 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761782 2558 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761786 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761790 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761793 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761796 2558 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761800 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761803 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761806 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761809 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761812 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761815 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761818 2558 flags.go:64] FLAG: --feature-gates="" Jul 06 19:23:16.885238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761823 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761826 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761830 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761833 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761837 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761840 2558 flags.go:64] FLAG: --help="false" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761843 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761847 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761850 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761852 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761856 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761860 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761863 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761866 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761868 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761872 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761875 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761878 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761881 2558 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761884 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761887 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761890 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761893 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761896 2558 flags.go:64] FLAG: --lock-file="" Jul 06 19:23:17.069996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761899 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761902 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761905 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761911 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761914 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761917 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761920 2558 flags.go:64] FLAG: --logging-format="text" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761923 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761928 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761931 2558 flags.go:64] FLAG: --manifest-url="" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761935 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761940 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761943 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761948 2558 flags.go:64] FLAG: --max-pods="110" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761951 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761954 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761957 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761960 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761963 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761967 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761970 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761978 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761981 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761984 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:23:17.084969 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761987 2558 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761991 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.761997 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762000 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762003 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762006 2558 flags.go:64] FLAG: --port="10250" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762009 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762012 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dae62d7dbf9be0a6" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762015 2558 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762018 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762021 2558 flags.go:64] FLAG: --register-node="true" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762025 2558 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762028 2558 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762031 2558 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762034 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762037 2558 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762041 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762047 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762051 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762054 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762057 2558 flags.go:64] FLAG: --runonce="false" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762060 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762063 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762067 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762070 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:23:17.101485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762073 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762076 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762079 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762082 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762086 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762089 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762092 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762109 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762113 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762116 2558 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762119 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762125 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762128 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762131 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762135 2558 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762139 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762142 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762145 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762148 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762151 2558 flags.go:64] FLAG: --v="2" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762162 2558 flags.go:64] FLAG: --version="false" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762166 2558 flags.go:64] FLAG: --vmodule="" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762170 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762173 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762296 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:17.102446 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762302 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762305 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762308 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762311 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762313 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762316 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762321 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762324 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762328 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762331 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762334 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762337 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762341 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762344 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762347 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762350 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762353 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762357 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762360 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:17.103206 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762363 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762366 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762369 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762372 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762374 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762377 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762380 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762383 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762386 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762389 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762392 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762394 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762398 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762402 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762405 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762408 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762410 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762413 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762416 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762419 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:17.104000 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762422 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762424 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762427 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762430 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762434 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762438 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762441 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762444 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762447 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762450 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762453 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762455 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762458 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762460 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762463 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762465 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762468 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762470 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762473 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:17.104817 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762476 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762478 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762481 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762484 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762487 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762491 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762495 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762498 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762500 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762503 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762506 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762508 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762511 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762514 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762516 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762519 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762521 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762524 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762526 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762529 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:17.105857 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762532 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762534 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762537 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762539 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762541 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762544 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762547 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762549 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762552 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762555 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762557 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762560 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762562 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762565 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762567 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762570 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762573 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762577 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762581 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:17.106610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.762583 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.762592 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.771138 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.771158 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.771179 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.771188 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771282 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771288 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771292 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771295 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771298 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771301 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771312 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771315 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771318 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:17.107565 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771321 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771323 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771326 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771329 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771332 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771335 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771340 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771345 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771348 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771351 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771355 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771359 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771361 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771365 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771368 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771370 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771373 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771376 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771379 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:17.108337 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771383 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771385 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771389 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771392 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771394 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771397 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771400 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771403 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771405 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771408 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771411 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771413 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771417 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771420 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771423 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771425 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771428 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771432 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771437 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771440 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:17.109282 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771442 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771445 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771448 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771451 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771453 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771456 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771460 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771463 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771466 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771468 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771471 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771474 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771477 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771479 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771482 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771486 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771488 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771491 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771494 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771496 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:17.110124 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771499 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771502 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771506 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771510 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771513 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771516 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771519 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771523 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771527 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771530 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771533 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771537 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771540 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771543 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771545 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771548 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771554 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771557 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771559 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771562 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:17.111123 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771565 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771568 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771570 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771573 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771576 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771579 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771581 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771584 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771587 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771590 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771593 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.771598 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771729 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771734 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:23:17.112010 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771737 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771740 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771743 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771746 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771749 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771751 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771754 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771757 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771760 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771763 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771766 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771768 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771771 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771776 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771779 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771783 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771785 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771788 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771790 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771793 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:23:17.112491 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771796 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771799 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771801 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771804 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771807 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771809 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771812 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771815 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771818 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771820 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771823 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771825 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771828 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771831 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771833 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771836 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771838 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771841 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771844 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771846 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:23:17.113036 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771849 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771851 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771854 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771857 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771860 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771865 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771867 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771871 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771875 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771879 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771882 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771885 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771889 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771891 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771894 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771897 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771899 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771902 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771904 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:23:17.113647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771907 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771910 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771914 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771917 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771920 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771922 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771925 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771928 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771930 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771933 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771935 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771938 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771940 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771943 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771946 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771948 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771951 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771954 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771959 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:23:17.114174 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771962 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771966 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771969 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771972 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771974 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771977 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771979 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771982 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771984 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771987 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771990 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771992 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771995 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.771997 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.772002 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.772005 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.772008 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.772011 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:23:17.114749 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:16.772014 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.772019 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.772169 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.774563 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.776213 2558 server.go:1019] "Starting client certificate rotation" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.777055 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.777090 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.779418 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.780694 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.792771 2558 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.795464 2558 log.go:25] "Validated CRI v1 image API" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.796377 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:23:17.115331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.800984 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0c2c0a2-d997-4e51-a3d5-2664916a40a2:/dev/nvme0n1p3 f7bc4e28-dea7-4b75-bb15-9cbd377290b4:/dev/nvme0n1p4] Jul 06 19:23:17.115726 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.801007 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.806674 2558 manager.go:216] Machine: {Timestamp:2026-07-06 19:23:16.805265351 +0000 UTC m=+0.371795196 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100041 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f22145feffd5ee014f35e92da683 SystemUUID:ec20f221-45fe-ffd5-ee01-4f35e92da683 BootID:ca667cc5-6851-48ca-90ec-714985754260 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:07:55:1e:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:07:55:1e:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:90:80:26:a7:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.806800 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.806901 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.810434 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.810657 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.810699 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:23:17.346738 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.813020 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.813035 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.813042 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.813797 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.815624 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819328 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819485 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819516 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819541 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819564 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819578 2558 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.819591 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.820078 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.820111 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.824627 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.827311 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.827379 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828950 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828964 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828971 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828977 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828986 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828991 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.828999 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829005 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829012 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829017 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829028 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829033 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.829679 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.829695 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829848 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.829857 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.833917 2558 server.go:1268] "Started kubelet" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.834009 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.834089 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.834370 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.835653 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.836700 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dxfvl" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.836825 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:23:17.347085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.837716 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.839978 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.844468 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.844485 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.844549 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845155 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845156 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845184 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845346 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845364 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.845547 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dxfvl" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847281 2558 factory.go:55] Registering systemd factory Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847294 2558 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847546 2558 factory.go:153] Registering CRI-O factory Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847561 2558 factory.go:223] Registration of the crio container factory successfully Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847637 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847656 2558 factory.go:103] Registering Raw factory Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.847882 2558 manager.go:1196] Started watching for new ooms in manager Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.848684 2558 manager.go:349] Starting recovery of all containers Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.851257 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.851420 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-242.ec2.internal.18bfc9be58d9e006 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-242.ec2.internal,UID:ip-10-0-143-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-242.ec2.internal,},FirstTimestamp:2026-07-06 19:23:16.833648646 +0000 UTC m=+0.400178489,LastTimestamp:2026-07-06 19:23:16.833648646 +0000 UTC m=+0.400178489,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-242.ec2.internal,}" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.858670 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-242.ec2.internal\" not found" node="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.860016 2558 manager.go:354] Recovery completed Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.864176 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866165 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866208 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866223 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866830 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866845 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866865 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.866866 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.867713 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.867740 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.867752 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.349006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.869199 2558 policy_none.go:49] "None policy: Start" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.869213 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.869224 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.870874 2558 policy_none.go:47] "Start" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.937808 2558 manager.go:337] "Starting Device Plugin manager" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.937848 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.937858 2558 server.go:87] "Starting device plugin registration server" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.938169 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.938180 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.938316 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.938397 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.938405 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.938874 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.938938 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.957444 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.958693 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.958729 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.958752 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:16.958787 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:16.961078 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.038921 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.039896 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.039926 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.039935 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.039965 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.048984 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.049009 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-242.ec2.internal\": node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.059638 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal"] Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.059709 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.060571 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.060599 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.060609 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.061009 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.061936 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062040 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062069 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062736 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062757 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.350017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062767 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062739 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062825 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.062834 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.064043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.064079 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.064841 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.064870 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.064884 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.106914 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-242.ec2.internal\" not found" node="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.112074 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-242.ec2.internal\" not found" node="ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.146808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.146839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd6b21424b4cc58df7f0f7a37abe13f5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-242.ec2.internal\" (UID: \"fd6b21424b4cc58df7f0f7a37abe13f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.146877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.161824 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd6b21424b4cc58df7f0f7a37abe13f5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-242.ec2.internal\" (UID: \"fd6b21424b4cc58df7f0f7a37abe13f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247337 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247692 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c80ee039ce9f9fde3730477da46785f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal\" (UID: \"c80ee039ce9f9fde3730477da46785f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.247820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd6b21424b4cc58df7f0f7a37abe13f5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-242.ec2.internal\" (UID: \"fd6b21424b4cc58df7f0f7a37abe13f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.351618 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.262403 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.589121 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.362503 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.589121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.410673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.589121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.415787 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:17.589121 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.462906 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.589121 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.563512 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.786800 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.664067 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.786800 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.765234 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.786800 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.775092 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:23:17.786800 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.775292 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:23:17.960880 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.848856 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:18:17 +0000 UTC" deadline="2028-02-12 13:30:32.780074321 +0000 UTC" Jul 06 19:23:17.960880 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.848890 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14058h7m14.931189591s" Jul 06 19:23:17.960880 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:17.866118 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-242.ec2.internal\" not found" Jul 06 19:23:17.962967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.961975 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:17.987494 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6b21424b4cc58df7f0f7a37abe13f5.slice/crio-f018f78f40352bfa6844da9b557977f67014d3d439ae533699c327c502b16b9a WatchSource:0}: Error finding container f018f78f40352bfa6844da9b557977f67014d3d439ae533699c327c502b16b9a: Status 404 returned error can't find the container with id f018f78f40352bfa6844da9b557977f67014d3d439ae533699c327c502b16b9a Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:17.988050 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80ee039ce9f9fde3730477da46785f3.slice/crio-a33e24684cd744c733843774ad6d4b0a913295f7c974f0609355383943689b1d WatchSource:0}: Error finding container a33e24684cd744c733843774ad6d4b0a913295f7c974f0609355383943689b1d: Status 404 returned error can't find the container with id a33e24684cd744c733843774ad6d4b0a913295f7c974f0609355383943689b1d Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:17.996866 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.046618 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.059570 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.062109 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.072257 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:23:18.199618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.112887 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:18.448523 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.412301 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:18.829766 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.820853 2558 apiserver.go:52] "Watching apiserver" Jul 06 19:23:18.831389 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.830486 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:23:18.831389 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.830879 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w4lgr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal","openshift-multus/multus-j9t6v","openshift-multus/network-metrics-daemon-748sj","openshift-network-diagnostics/network-check-target-75zgj","openshift-network-operator/iptables-alerter-ghsvm","openshift-ovn-kubernetes/ovnkube-node-l888q","kube-system/konnectivity-agent-9gtdh","kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4","openshift-cluster-node-tuning-operator/tuned-tbcsq","openshift-image-registry/node-ca-677sr","openshift-multus/multus-additional-cni-plugins-mhrfm"] Jul 06 19:23:18.832874 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.832647 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.834678 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.834413 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.835565 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.835587 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.835826 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.835885 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.835966 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.836539 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.836647 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q8jwm\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.836770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.836888 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.837046 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.837116 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.837427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.838295 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.838328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.838339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5b8b9\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.838335 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.838660 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.841149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.841211 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.841244 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.841667 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.841683 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-krkft\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.841688 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.842980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.844393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.845065 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:23:18.907368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.846129 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dh85b\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.846356 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.846614 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.847400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.847663 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.847899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.847949 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.848285 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s87gk\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.848712 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.848957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.849540 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r6j4f\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.849572 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.849644 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.850559 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.851422 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.851714 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hd2z8\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.852255 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.852282 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.852733 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.853237 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nrvwq\"" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.857941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8pgg\" (UniqueName: \"kubernetes.io/projected/085dcf60-7700-4073-9d76-96fe185d26a4-kube-api-access-v8pgg\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.857976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-log-socket\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-host\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-kubelet\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.908968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-multus-certs\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-etc-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858171 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-conf-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-slash\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-config\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovn-node-metrics-cert\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525a9ded-c749-4af3-a6f1-4c1c80e6490d-konnectivity-ca\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-netd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-registration-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-device-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858433 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bhc\" (UniqueName: \"kubernetes.io/projected/1c871165-f265-428a-8303-f9697c61cf41-kube-api-access-v5bhc\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-tuned\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.910158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bh2z\" (UniqueName: \"kubernetes.io/projected/fac5a664-ea0b-4dde-93c2-7a1507ea4008-kube-api-access-4bh2z\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-kubelet\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-systemd-units\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-socket-dir-parent\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/446f2867-d859-42c0-9927-6dc9cb1aea7b-iptables-alerter-script\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-kubelet-config\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-systemd\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-var-lib-kubelet\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-multus\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858771 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-ovn\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-sys-fs\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-dbus\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.910998 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-system-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-conf\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.858975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0773a41-2e3f-4be6-afe2-f044553267d5-host\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0773a41-2e3f-4be6-afe2-f044553267d5-serviceca\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2v7\" (UniqueName: \"kubernetes.io/projected/446f2867-d859-42c0-9927-6dc9cb1aea7b-kube-api-access-4z2v7\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-kubernetes\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsdct\" (UniqueName: \"kubernetes.io/projected/5de68b83-bea1-4e9d-aceb-c738ae92ec30-kube-api-access-vsdct\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-run\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmr7n\" (UniqueName: \"kubernetes.io/projected/a0773a41-2e3f-4be6-afe2-f044553267d5-kube-api-access-fmr7n\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-netns\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-etc-kubernetes\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/446f2867-d859-42c0-9927-6dc9cb1aea7b-host-slash\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-node-log\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.912152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-bin\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-lib-modules\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-tmp\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859436 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-k8s-cni-cncf-io\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-hostroot\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-socket-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-os-release\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-cni-binary-copy\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-bin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-netns\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859696 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-script-lib\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysconfig\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-sys\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859881 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-systemd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.859968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-modprobe-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-cnibin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-multus-daemon-config\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-var-lib-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-env-overrides\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860145 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87cfc\" (UniqueName: \"kubernetes.io/projected/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-kube-api-access-87cfc\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.860191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525a9ded-c749-4af3-a6f1-4c1c80e6490d-agent-certs\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.871287 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.896958 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-strdz" Jul 06 19:23:18.914939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.911703 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-strdz" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.946514 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-modprobe-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-cnibin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-multus-daemon-config\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-var-lib-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-env-overrides\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.960982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87cfc\" (UniqueName: \"kubernetes.io/projected/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-kube-api-access-87cfc\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525a9ded-c749-4af3-a6f1-4c1c80e6490d-agent-certs\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8pgg\" (UniqueName: \"kubernetes.io/projected/085dcf60-7700-4073-9d76-96fe185d26a4-kube-api-access-v8pgg\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-log-socket\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-host\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-kubelet\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.990768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-multus-certs\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-etc-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-cnibin\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-conf-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-slash\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-config\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovn-node-metrics-cert\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525a9ded-c749-4af3-a6f1-4c1c80e6490d-konnectivity-ca\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-netd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-registration-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961435 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-device-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bhc\" (UniqueName: \"kubernetes.io/projected/1c871165-f265-428a-8303-f9697c61cf41-kube-api-access-v5bhc\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.992626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-tuned\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bh2z\" (UniqueName: \"kubernetes.io/projected/fac5a664-ea0b-4dde-93c2-7a1507ea4008-kube-api-access-4bh2z\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-kubelet\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-systemd-units\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-socket-dir-parent\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/446f2867-d859-42c0-9927-6dc9cb1aea7b-iptables-alerter-script\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-kubelet-config\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-systemd\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-var-lib-kubelet\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-multus\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-ovn\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-sys-fs\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.993345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-dbus\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9w9p\" (UniqueName: \"kubernetes.io/projected/ab409135-cd36-40fc-8a5b-120cb0469f9f-kube-api-access-w9w9p\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-system-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-conf\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0773a41-2e3f-4be6-afe2-f044553267d5-host\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962014 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0773a41-2e3f-4be6-afe2-f044553267d5-serviceca\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2v7\" (UniqueName: \"kubernetes.io/projected/446f2867-d859-42c0-9927-6dc9cb1aea7b-kube-api-access-4z2v7\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-kubernetes\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdct\" (UniqueName: \"kubernetes.io/projected/5de68b83-bea1-4e9d-aceb-c738ae92ec30-kube-api-access-vsdct\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-os-release\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-log-socket\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.995431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-run\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-etc-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.961877 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-kubelet\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmr7n\" (UniqueName: \"kubernetes.io/projected/a0773a41-2e3f-4be6-afe2-f044553267d5-kube-api-access-fmr7n\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-netns\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962272 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-host\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962653 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-conf-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-systemd-units\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-kubelet\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-modprobe-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-device-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-systemd\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-cnibin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962856 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-kubelet-config\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.996140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962943 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-socket-dir-parent\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a74285f6-c63b-4576-9daf-fadb5c2788fb-dbus\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.962983 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-multus-certs\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963005 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-registration-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-var-lib-kubelet\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-sys-fs\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963070 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-ovn\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963106 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-netns\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963155 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-multus-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.963168 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963214 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-run\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963241 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-slash\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.963399 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:19.463352565 +0000 UTC m=+3.029882419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.963566 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-multus-daemon-config\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525a9ded-c749-4af3-a6f1-4c1c80e6490d-konnectivity-ca\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:18.998521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-etc-kubernetes\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/446f2867-d859-42c0-9927-6dc9cb1aea7b-host-slash\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-node-log\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964297 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-env-overrides\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964322 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-config\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-var-lib-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/446f2867-d859-42c0-9927-6dc9cb1aea7b-host-slash\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-bin\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0773a41-2e3f-4be6-afe2-f044553267d5-host\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-conf\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-lib-modules\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-tmp\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-k8s-cni-cncf-io\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:18.999982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-hostroot\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-socket-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-os-release\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-run-k8s-cni-cncf-io\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-cni-binary-copy\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/446f2867-d859-42c0-9927-6dc9cb1aea7b-iptables-alerter-script\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964924 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-hostroot\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-bin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964950 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-multus\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-netns\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-system-cni-dir\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-etc-kubernetes\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.964989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.003497 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-node-log\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-ovn-kubernetes\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-script-lib\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysctl-d\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965106 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-etc-selinux\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-lib-modules\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysconfig\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-sys\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-systemd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-system-cni-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.965429 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.965475 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:19.46546052 +0000 UTC m=+3.031990374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0773a41-2e3f-4be6-afe2-f044553267d5-serviceca\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:19.004482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-socket-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c871165-f265-428a-8303-f9697c61cf41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-bin\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovnkube-script-lib\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-os-release\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-sysconfig\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-sys\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.965989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-systemd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966153 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-run-openvswitch\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/085dcf60-7700-4073-9d76-96fe185d26a4-host-var-lib-cni-bin\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/085dcf60-7700-4073-9d76-96fe185d26a4-cni-binary-copy\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-run-netns\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966603 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-kubernetes\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.966734 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-host-cni-netd\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.969653 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-tmp\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.006429 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.969763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fac5a664-ea0b-4dde-93c2-7a1507ea4008-etc-tuned\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.970355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-ovn-node-metrics-cert\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.972361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525a9ded-c749-4af3-a6f1-4c1c80e6490d-agent-certs\") pod \"konnectivity-agent-9gtdh\" (UID: \"525a9ded-c749-4af3-a6f1-4c1c80e6490d\") " pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.981142 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.981165 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.981193 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:18.981259 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:19.48124261 +0000 UTC m=+3.047772460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.984577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8pgg\" (UniqueName: \"kubernetes.io/projected/085dcf60-7700-4073-9d76-96fe185d26a4-kube-api-access-v8pgg\") pod \"multus-j9t6v\" (UID: \"085dcf60-7700-4073-9d76-96fe185d26a4\") " pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.986023 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdct\" (UniqueName: \"kubernetes.io/projected/5de68b83-bea1-4e9d-aceb-c738ae92ec30-kube-api-access-vsdct\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.986795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bh2z\" (UniqueName: \"kubernetes.io/projected/fac5a664-ea0b-4dde-93c2-7a1507ea4008-kube-api-access-4bh2z\") pod \"tuned-tbcsq\" (UID: \"fac5a664-ea0b-4dde-93c2-7a1507ea4008\") " pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.987043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87cfc\" (UniqueName: \"kubernetes.io/projected/ce758bcc-d41d-4e9b-9aa9-269f56d8218e-kube-api-access-87cfc\") pod \"ovnkube-node-l888q\" (UID: \"ce758bcc-d41d-4e9b-9aa9-269f56d8218e\") " pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.988109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmr7n\" (UniqueName: \"kubernetes.io/projected/a0773a41-2e3f-4be6-afe2-f044553267d5-kube-api-access-fmr7n\") pod \"node-ca-677sr\" (UID: \"a0773a41-2e3f-4be6-afe2-f044553267d5\") " pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.988883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bhc\" (UniqueName: \"kubernetes.io/projected/1c871165-f265-428a-8303-f9697c61cf41-kube-api-access-v5bhc\") pod \"aws-ebs-csi-driver-node-7v6c4\" (UID: \"1c871165-f265-428a-8303-f9697c61cf41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.996131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2v7\" (UniqueName: \"kubernetes.io/projected/446f2867-d859-42c0-9927-6dc9cb1aea7b-kube-api-access-4z2v7\") pod \"iptables-alerter-ghsvm\" (UID: \"446f2867-d859-42c0-9927-6dc9cb1aea7b\") " pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:19.007375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:18.997455 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.035760 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghsvm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.039711 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" event={"ID":"fd6b21424b4cc58df7f0f7a37abe13f5","Type":"ContainerStarted","Data":"f018f78f40352bfa6844da9b557977f67014d3d439ae533699c327c502b16b9a"} Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.044409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" event={"ID":"c80ee039ce9f9fde3730477da46785f3","Type":"ContainerStarted","Data":"a33e24684cd744c733843774ad6d4b0a913295f7c974f0609355383943689b1d"} Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.057711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.064641 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.065755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.065795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9w9p\" (UniqueName: \"kubernetes.io/projected/ab409135-cd36-40fc-8a5b-120cb0469f9f-kube-api-access-w9w9p\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-os-release\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-system-cni-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-cnibin\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-system-cni-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.106879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-os-release\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-cnibin\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab409135-cd36-40fc-8a5b-120cb0469f9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.066884 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab409135-cd36-40fc-8a5b-120cb0469f9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.072347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.080439 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-677sr" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.080884 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9w9p\" (UniqueName: \"kubernetes.io/projected/ab409135-cd36-40fc-8a5b-120cb0469f9f-kube-api-access-w9w9p\") pod \"multus-additional-cni-plugins-mhrfm\" (UID: \"ab409135-cd36-40fc-8a5b-120cb0469f9f\") " pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.110690 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.092378 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" Jul 06 19:23:19.220849 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.188827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:19.220849 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.198156 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9t6v" Jul 06 19:23:19.469990 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.469959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:19.470096 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.470021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:19.470159 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.470145 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:19.470232 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.470150 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:19.470232 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.470208 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:20.470188087 +0000 UTC m=+4.036717923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:19.470232 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.470224 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:20.470216948 +0000 UTC m=+4.036746781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:19.570785 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.570750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:19.570969 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.570938 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:19.570969 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.570957 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:19.570969 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.570968 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:19.571113 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:19.571035 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:20.571016678 +0000 UTC m=+4.137546529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:19.914587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.914524 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:19 +0000 UTC" deadline="2028-02-09 14:24:19.906424803 +0000 UTC" Jul 06 19:23:19.914587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:19.914588 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13987h0m59.991842174s" Jul 06 19:23:20.231567 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.231532 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446f2867_d859_42c0_9927_6dc9cb1aea7b.slice/crio-1cdd9bd1a37e0ecdbc853f936f19e4a6a78c06d1f90420cfdf60283d6baaf563 WatchSource:0}: Error finding container 1cdd9bd1a37e0ecdbc853f936f19e4a6a78c06d1f90420cfdf60283d6baaf563: Status 404 returned error can't find the container with id 1cdd9bd1a37e0ecdbc853f936f19e4a6a78c06d1f90420cfdf60283d6baaf563 Jul 06 19:23:20.232790 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.232763 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525a9ded_c749_4af3_a6f1_4c1c80e6490d.slice/crio-b077332d37a305a4feac4db2e046847fed871fc4b5ef58601003d5c68d4e287e WatchSource:0}: Error finding container b077332d37a305a4feac4db2e046847fed871fc4b5ef58601003d5c68d4e287e: Status 404 returned error can't find the container with id b077332d37a305a4feac4db2e046847fed871fc4b5ef58601003d5c68d4e287e Jul 06 19:23:20.233865 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.233836 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c871165_f265_428a_8303_f9697c61cf41.slice/crio-db407f03e588cb7e59b230e6b39c87ea2075779dab857da2953ab40fc4489e93 WatchSource:0}: Error finding container db407f03e588cb7e59b230e6b39c87ea2075779dab857da2953ab40fc4489e93: Status 404 returned error can't find the container with id db407f03e588cb7e59b230e6b39c87ea2075779dab857da2953ab40fc4489e93 Jul 06 19:23:20.239227 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.238519 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac5a664_ea0b_4dde_93c2_7a1507ea4008.slice/crio-ffd26f4add94868b1e66c236036621edbcd61c163e32bcedb0cd52083770bf5e WatchSource:0}: Error finding container ffd26f4add94868b1e66c236036621edbcd61c163e32bcedb0cd52083770bf5e: Status 404 returned error can't find the container with id ffd26f4add94868b1e66c236036621edbcd61c163e32bcedb0cd52083770bf5e Jul 06 19:23:20.239949 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.239864 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce758bcc_d41d_4e9b_9aa9_269f56d8218e.slice/crio-33c8fe3377a901075282a3acd58c9c5ec9f4e44aed63a8092b6a67f0c082367a WatchSource:0}: Error finding container 33c8fe3377a901075282a3acd58c9c5ec9f4e44aed63a8092b6a67f0c082367a: Status 404 returned error can't find the container with id 33c8fe3377a901075282a3acd58c9c5ec9f4e44aed63a8092b6a67f0c082367a Jul 06 19:23:20.244335 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.243978 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085dcf60_7700_4073_9d76_96fe185d26a4.slice/crio-8df1d40d45816f3a481d51fe5031ee839c7dd8952fe8fe3917f709d614aa8108 WatchSource:0}: Error finding container 8df1d40d45816f3a481d51fe5031ee839c7dd8952fe8fe3917f709d614aa8108: Status 404 returned error can't find the container with id 8df1d40d45816f3a481d51fe5031ee839c7dd8952fe8fe3917f709d614aa8108 Jul 06 19:23:20.245157 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:20.245127 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab409135_cd36_40fc_8a5b_120cb0469f9f.slice/crio-3f72406a0dbf59af6bbe7b4be96ed0d6d4bfdb964691a345cb6e10b9ecd16fa3 WatchSource:0}: Error finding container 3f72406a0dbf59af6bbe7b4be96ed0d6d4bfdb964691a345cb6e10b9ecd16fa3: Status 404 returned error can't find the container with id 3f72406a0dbf59af6bbe7b4be96ed0d6d4bfdb964691a345cb6e10b9ecd16fa3 Jul 06 19:23:20.477645 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.477371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:20.477645 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.477626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:20.477882 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.477548 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:20.477882 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.477722 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:20.477882 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.477730 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:22.477710116 +0000 UTC m=+6.044239948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:20.477882 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.477766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:22.47775378 +0000 UTC m=+6.044283612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:20.578558 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.578521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:20.578707 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.578653 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:20.578707 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.578668 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:20.578707 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.578678 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:20.578838 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.578730 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:22.578716507 +0000 UTC m=+6.145246353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:20.914897 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.914736 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:18:19 +0000 UTC" deadline="2027-12-08 15:15:17.050392959 +0000 UTC" Jul 06 19:23:20.914897 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.914808 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12475h51m56.135590338s" Jul 06 19:23:20.962002 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.961967 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:20.962175 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.962125 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:20.962308 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.962292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:20.963048 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.963008 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:20.963193 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.963160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:20.963279 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:20.963260 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:20.999910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:20.999042 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-vcnb6"] Jul 06 19:23:21.002334 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.002306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.006619 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.006075 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:23:21.006619 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.006101 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5d7nv\"" Jul 06 19:23:21.006619 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.006421 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:23:21.057990 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.057950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"33c8fe3377a901075282a3acd58c9c5ec9f4e44aed63a8092b6a67f0c082367a"} Jul 06 19:23:21.071611 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.071567 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" event={"ID":"fac5a664-ea0b-4dde-93c2-7a1507ea4008","Type":"ContainerStarted","Data":"ffd26f4add94868b1e66c236036621edbcd61c163e32bcedb0cd52083770bf5e"} Jul 06 19:23:21.078874 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.078738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gtdh" event={"ID":"525a9ded-c749-4af3-a6f1-4c1c80e6490d","Type":"ContainerStarted","Data":"b077332d37a305a4feac4db2e046847fed871fc4b5ef58601003d5c68d4e287e"} Jul 06 19:23:21.083391 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.083357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc354b56-0837-4b6a-9b8a-cef809dded26-tmp-dir\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.083562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.083404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rptdq\" (UniqueName: \"kubernetes.io/projected/dc354b56-0837-4b6a-9b8a-cef809dded26-kube-api-access-rptdq\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.083562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.083435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc354b56-0837-4b6a-9b8a-cef809dded26-hosts-file\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.088343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.088305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghsvm" event={"ID":"446f2867-d859-42c0-9927-6dc9cb1aea7b","Type":"ContainerStarted","Data":"1cdd9bd1a37e0ecdbc853f936f19e4a6a78c06d1f90420cfdf60283d6baaf563"} Jul 06 19:23:21.101894 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.101847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" event={"ID":"fd6b21424b4cc58df7f0f7a37abe13f5","Type":"ContainerStarted","Data":"49247db9ccd6f8107f98c883093fc4d5078754132d5733354ff13405cefe1950"} Jul 06 19:23:21.113335 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.113292 2558 generic.go:356] "Generic (PLEG): container finished" podID="c80ee039ce9f9fde3730477da46785f3" containerID="4592f30fbbb999fc10ff6d19b56f0323a01c2b6be7783749e11cc6465dd8ab00" exitCode=0 Jul 06 19:23:21.113660 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.113630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" event={"ID":"c80ee039ce9f9fde3730477da46785f3","Type":"ContainerDied","Data":"4592f30fbbb999fc10ff6d19b56f0323a01c2b6be7783749e11cc6465dd8ab00"} Jul 06 19:23:21.135954 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.135906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-677sr" event={"ID":"a0773a41-2e3f-4be6-afe2-f044553267d5","Type":"ContainerStarted","Data":"ed6d0ad2e366f61689a88be2a294aae81d15c6b1f75cc5a3ce66c89aba9143ec"} Jul 06 19:23:21.145805 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.145746 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-242.ec2.internal" podStartSLOduration=3.145726166 podStartE2EDuration="3.145726166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:21.122560186 +0000 UTC m=+4.689090044" watchObservedRunningTime="2026-07-06 19:23:21.145726166 +0000 UTC m=+4.712256190" Jul 06 19:23:21.159695 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.159604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerStarted","Data":"3f72406a0dbf59af6bbe7b4be96ed0d6d4bfdb964691a345cb6e10b9ecd16fa3"} Jul 06 19:23:21.171984 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.171898 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" event={"ID":"1c871165-f265-428a-8303-f9697c61cf41","Type":"ContainerStarted","Data":"db407f03e588cb7e59b230e6b39c87ea2075779dab857da2953ab40fc4489e93"} Jul 06 19:23:21.183905 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.183858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc354b56-0837-4b6a-9b8a-cef809dded26-tmp-dir\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.183905 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.183909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rptdq\" (UniqueName: \"kubernetes.io/projected/dc354b56-0837-4b6a-9b8a-cef809dded26-kube-api-access-rptdq\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.184180 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.183937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc354b56-0837-4b6a-9b8a-cef809dded26-hosts-file\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.184180 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.184076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc354b56-0837-4b6a-9b8a-cef809dded26-hosts-file\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.184476 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.184450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc354b56-0837-4b6a-9b8a-cef809dded26-tmp-dir\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.186342 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.186307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9t6v" event={"ID":"085dcf60-7700-4073-9d76-96fe185d26a4","Type":"ContainerStarted","Data":"8df1d40d45816f3a481d51fe5031ee839c7dd8952fe8fe3917f709d614aa8108"} Jul 06 19:23:21.203642 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.203600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rptdq\" (UniqueName: \"kubernetes.io/projected/dc354b56-0837-4b6a-9b8a-cef809dded26-kube-api-access-rptdq\") pod \"node-resolver-vcnb6\" (UID: \"dc354b56-0837-4b6a-9b8a-cef809dded26\") " pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.316590 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:21.316307 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vcnb6" Jul 06 19:23:21.340648 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:21.340597 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc354b56_0837_4b6a_9b8a_cef809dded26.slice/crio-4ae548950d970c0bb680f9877777498ebbcf66553b1057772cecf0801501583c WatchSource:0}: Error finding container 4ae548950d970c0bb680f9877777498ebbcf66553b1057772cecf0801501583c: Status 404 returned error can't find the container with id 4ae548950d970c0bb680f9877777498ebbcf66553b1057772cecf0801501583c Jul 06 19:23:22.210374 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.210261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" event={"ID":"c80ee039ce9f9fde3730477da46785f3","Type":"ContainerStarted","Data":"3964b1626bb0a4f0c69c3982878de852b76b4974af05109b778957e39f61ef45"} Jul 06 19:23:22.245063 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.244980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vcnb6" event={"ID":"dc354b56-0837-4b6a-9b8a-cef809dded26","Type":"ContainerStarted","Data":"4ae548950d970c0bb680f9877777498ebbcf66553b1057772cecf0801501583c"} Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.495216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.495298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.495379 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.495450 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:26.495429583 +0000 UTC m=+10.061959432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.495379 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:22.495897 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.495525 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:26.495511658 +0000 UTC m=+10.062041505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:22.597486 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.596723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:22.597486 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.596973 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:22.597486 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.596999 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:22.597486 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.597016 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:22.597486 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.597079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:26.597059518 +0000 UTC m=+10.163589373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:22.960415 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.960316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:22.960594 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.960481 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:22.960991 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.960964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:22.961095 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.961070 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:22.961171 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:22.961145 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:22.961264 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:22.961243 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:24.960322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:24.960283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:24.960836 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:24.960438 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:24.960909 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:24.960842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:24.960966 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:24.960937 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:24.961025 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:24.960966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:24.961078 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:24.961043 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:26.534734 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.534521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:26.534734 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.534596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:26.534734 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.534702 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:26.535295 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.534780 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:34.534757811 +0000 UTC m=+18.101287659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:26.535295 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.534714 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:26.535295 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.535185 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:34.53516817 +0000 UTC m=+18.101698017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:26.635614 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.635575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:26.635797 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.635747 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:26.635797 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.635768 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:26.635797 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.635781 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:26.635985 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.635848 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:34.635827833 +0000 UTC m=+18.202357955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.960803 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.960890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:26.960926 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.960940 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.961004 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:26.961199 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:26.961093 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:28.959322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:28.959123 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:28.959322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:28.959123 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:28.959322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:28.959263 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:28.959322 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:28.959277 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:28.959928 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:28.959359 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:28.959928 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:28.959442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:30.959807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:30.959768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:30.960247 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:30.959768 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:30.960247 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:30.959923 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:30.960247 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:30.959767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:30.960247 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:30.959999 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:30.960247 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:30.960055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:32.959744 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:32.959706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:32.960220 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:32.959754 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:32.960220 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:32.959706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:32.960220 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:32.959856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:32.960220 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:32.959945 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:32.960220 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:32.960023 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:34.597040 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.597002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:34.597536 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.597055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:34.597536 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.597182 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:34.597536 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.597192 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:34.597536 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.597246 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:50.597226874 +0000 UTC m=+34.163756708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:34.597536 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.597261 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:23:50.597254956 +0000 UTC m=+34.163784787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:34.697913 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.697873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:34.698145 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.698030 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:34.698145 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.698057 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:34.698145 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.698074 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:34.698299 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.698158 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:23:50.698137927 +0000 UTC m=+34.264667766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:34.959870 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.959784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:34.960020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.959785 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:34.960020 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.959943 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:34.960020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:34.959784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:34.960020 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.959982 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:34.960212 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:34.960085 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:36.959743 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:36.959711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:36.960224 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:36.959830 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:36.960224 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:36.959847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:36.960224 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:36.959954 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:36.960224 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:36.960018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:36.960224 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:36.960079 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:38.959756 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:38.959715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:38.960309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:38.959715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:38.960309 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:38.959855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:38.960309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:38.959728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:38.960309 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:38.959967 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:38.960309 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:38.960060 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:40.285236 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.284715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9t6v" event={"ID":"085dcf60-7700-4073-9d76-96fe185d26a4","Type":"ContainerStarted","Data":"e60e614564181b58bf3fdf4400d5501aaff487749e394cbd3192772c623a7dce"} Jul 06 19:23:40.288292 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"1dc9762bbffde934378cbce856591b02fd131b3d5c9aef7bd4426fee6dd91245"} Jul 06 19:23:40.288448 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"ede81bd340543044faed08dfd7ee80d895a98567598f826498beea38147bef89"} Jul 06 19:23:40.288448 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"69f60c39706102b3c54ea2b7c305fb651dddee209f2069133e29ad5175eb36da"} Jul 06 19:23:40.288448 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"f1c29314fcff8a6b6a9accc140506931a67248a9c223e62addc9cc2308a76869"} Jul 06 19:23:40.288448 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288417 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"be9b8f736df379c5668caa1866d1f20b275bfd12eac16e089e98c900deea7d30"} Jul 06 19:23:40.288663 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.288465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"79dc1cfd333efb828780ce75f744214ecf6c262f78293cf1f5647995c226f469"} Jul 06 19:23:40.292828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.292793 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" event={"ID":"fac5a664-ea0b-4dde-93c2-7a1507ea4008","Type":"ContainerStarted","Data":"43fcd8ad4e6a30f459e1a0bf5543caa9a6f610f4086dcf5aac54d88f9c51c225"} Jul 06 19:23:40.294651 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.294621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gtdh" event={"ID":"525a9ded-c749-4af3-a6f1-4c1c80e6490d","Type":"ContainerStarted","Data":"aab846bf2a4a91839f67a403e592e6c41c45952294a224a79e247352a9157a1b"} Jul 06 19:23:40.296219 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.296184 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-677sr" event={"ID":"a0773a41-2e3f-4be6-afe2-f044553267d5","Type":"ContainerStarted","Data":"370a59761d99673d7c94926e2d5f6e31ebefd9a6d9e939b8e03bacf2863b86e1"} Jul 06 19:23:40.298203 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.298175 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="7f9157b50ad3057d029e9015cc0b468b2bf1031a50d87f2855c5f308c2a1177f" exitCode=0 Jul 06 19:23:40.298299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.298262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"7f9157b50ad3057d029e9015cc0b468b2bf1031a50d87f2855c5f308c2a1177f"} Jul 06 19:23:40.299970 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.299932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" event={"ID":"1c871165-f265-428a-8303-f9697c61cf41","Type":"ContainerStarted","Data":"7fb307a235abe25684078b14e24066b99653d8562eadc88008eb35823558a62a"} Jul 06 19:23:40.301454 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.301431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vcnb6" event={"ID":"dc354b56-0837-4b6a-9b8a-cef809dded26","Type":"ContainerStarted","Data":"3cfa1a2ead54f10a9fb6b175e9d4d5db1f0cf5d0b806c23fe56fea79eb7f761c"} Jul 06 19:23:40.306652 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.306608 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-242.ec2.internal" podStartSLOduration=22.306594554 podStartE2EDuration="22.306594554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:22.232119702 +0000 UTC m=+5.798649561" watchObservedRunningTime="2026-07-06 19:23:40.306594554 +0000 UTC m=+23.873124407" Jul 06 19:23:40.306788 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.306691 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9t6v" podStartSLOduration=4.015083967 podStartE2EDuration="23.306684198s" totalImagesPullingTime="19.291600231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:40.306371163 +0000 UTC m=+23.872901017" watchObservedRunningTime="2026-07-06 19:23:40.306684198 +0000 UTC m=+23.873214054" Jul 06 19:23:40.326566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.326505 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-677sr" podStartSLOduration=4.084616112 podStartE2EDuration="23.326484213s" totalImagesPullingTime="19.241868101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:40.325961468 +0000 UTC m=+23.892491327" watchObservedRunningTime="2026-07-06 19:23:40.326484213 +0000 UTC m=+23.893014069" Jul 06 19:23:40.368207 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.368162 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vcnb6" podStartSLOduration=1.226574696 podStartE2EDuration="19.36814689s" totalImagesPullingTime="18.141572194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:40.367879731 +0000 UTC m=+23.934409594" watchObservedRunningTime="2026-07-06 19:23:40.36814689 +0000 UTC m=+23.934676742" Jul 06 19:23:40.385215 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.385166 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tbcsq" podStartSLOduration=4.134570424 podStartE2EDuration="23.385149674s" totalImagesPullingTime="19.25057925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:40.384772988 +0000 UTC m=+23.951302841" watchObservedRunningTime="2026-07-06 19:23:40.385149674 +0000 UTC m=+23.951679527" Jul 06 19:23:40.405628 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.405576 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9gtdh" podStartSLOduration=12.186890264 podStartE2EDuration="23.405559058s" totalImagesPullingTime="11.218668794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:40.40530549 +0000 UTC m=+23.971835344" watchObservedRunningTime="2026-07-06 19:23:40.405559058 +0000 UTC m=+23.972088910" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.960403 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.960410 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:40.960537 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:40.960557 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:40.960664 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:40.960878 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:40.960726 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:41.077506 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.077462 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:23:41.305419 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.305379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghsvm" event={"ID":"446f2867-d859-42c0-9927-6dc9cb1aea7b","Type":"ContainerStarted","Data":"92f02c902cc7f1a8eb4a9679cfc89abe93f6a1d8a9137f5bcbb79c6b3867e8e2"} Jul 06 19:23:41.307506 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.307474 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" event={"ID":"1c871165-f265-428a-8303-f9697c61cf41","Type":"ContainerStarted","Data":"33c9ff6bc5f984895aa10f66f78d413269720d632f9064a78d03fa67a0f79962"} Jul 06 19:23:41.325502 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.325399 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ghsvm" podStartSLOduration=5.070917122 podStartE2EDuration="24.325382005s" totalImagesPullingTime="19.254464883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:41.324545671 +0000 UTC m=+24.891075524" watchObservedRunningTime="2026-07-06 19:23:41.325382005 +0000 UTC m=+24.891911859" Jul 06 19:23:41.951157 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.951034 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:23:41.077485844Z","UUID":"bf17fedb-30a1-4868-ae6f-e380e808f47d","Handler":null,"Name":"","Endpoint":""} Jul 06 19:23:41.956785 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.952890 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:23:41.956785 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:41.953205 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:23:42.099591 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.099553 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:42.100191 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.100160 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:42.316527 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.316382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"3f5d574435c13e0c613e5fb550180c89206a82c061f252a22692d5432d8c7350"} Jul 06 19:23:42.317224 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.317200 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:42.317562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.317545 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9gtdh" Jul 06 19:23:42.959451 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.959209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:42.959645 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.959209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:42.959645 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:42.959590 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:42.959645 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:42.959623 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:42.959645 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:42.959247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:42.959795 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:42.959697 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:43.320721 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:43.320640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" event={"ID":"1c871165-f265-428a-8303-f9697c61cf41","Type":"ContainerStarted","Data":"a39466b951f76b202fc2a2405265315f2389653d46b328d1895bf19d1256ffaa"} Jul 06 19:23:43.341859 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:43.341798 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7v6c4" podStartSLOduration=4.789699249 podStartE2EDuration="26.341775344s" totalImagesPullingTime="21.552076095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:43.341075653 +0000 UTC m=+26.907605515" watchObservedRunningTime="2026-07-06 19:23:43.341775344 +0000 UTC m=+26.908305198" Jul 06 19:23:44.959638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:44.959362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:44.959638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:44.959367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:44.960468 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:44.959648 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:44.960468 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:44.959397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:44.960468 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:44.959701 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:44.960468 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:44.959810 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:45.328760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.328670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" event={"ID":"ce758bcc-d41d-4e9b-9aa9-269f56d8218e","Type":"ContainerStarted","Data":"367ace26551c99233b6b964dab128f1f04cd92835eadf0b67fdd4fefea13eeea"} Jul 06 19:23:45.328939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.328904 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:45.329005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.328976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:45.330504 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.330481 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="05cfc594f7103b9312e907cc0d9b4369cffcc927bc3d1b79e368fdcabda73349" exitCode=0 Jul 06 19:23:45.330642 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.330509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"05cfc594f7103b9312e907cc0d9b4369cffcc927bc3d1b79e368fdcabda73349"} Jul 06 19:23:45.345120 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.345077 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:45.357209 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:45.357164 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" podStartSLOduration=9.048700336 podStartE2EDuration="28.357149882s" totalImagesPullingTime="19.308449546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:45.356765655 +0000 UTC m=+28.923295517" watchObservedRunningTime="2026-07-06 19:23:45.357149882 +0000 UTC m=+28.923679735" Jul 06 19:23:46.332869 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.332840 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:46.347324 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.347295 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:23:46.752977 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.752896 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75zgj"] Jul 06 19:23:46.753166 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.753059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:46.753261 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:46.753213 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:46.754399 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.754371 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-748sj"] Jul 06 19:23:46.754510 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.754465 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:46.754573 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:46.754547 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:46.754945 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.754905 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4lgr"] Jul 06 19:23:46.755041 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:46.755013 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:46.755120 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:46.755084 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:47.336908 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:47.336872 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="052f3212ed3a033d0975f5b59a0740abdd636a31b59ab73eca85b58a7e146db1" exitCode=0 Jul 06 19:23:47.337312 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:47.336953 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"052f3212ed3a033d0975f5b59a0740abdd636a31b59ab73eca85b58a7e146db1"} Jul 06 19:23:48.960043 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:48.959843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:48.960592 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:48.959843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:48.960592 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:48.960155 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:48.960592 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:48.959855 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:48.960592 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:48.960210 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:48.960592 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:48.960291 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:49.343887 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:49.343805 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="b256fc58b0df0c961077629e639153b853a475bdbe4861cb15b729b039235078" exitCode=0 Jul 06 19:23:49.343887 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:49.343866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"b256fc58b0df0c961077629e639153b853a475bdbe4861cb15b729b039235078"} Jul 06 19:23:49.391299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:49.391269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:49.482910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:49.482875 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:50.617894 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.617856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:50.618482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.617917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:50.618482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.618022 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:50.618482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.618032 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:50.618482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.618087 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret podName:a74285f6-c63b-4576-9daf-fadb5c2788fb nodeName:}" failed. No retries permitted until 2026-07-06 19:24:22.618070395 +0000 UTC m=+66.184600226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret") pod "global-pull-secret-syncer-w4lgr" (UID: "a74285f6-c63b-4576-9daf-fadb5c2788fb") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:23:50.618482 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.618126 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:22.618116554 +0000 UTC m=+66.184646396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:23:50.718483 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.718392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:50.718738 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.718570 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:23:50.718738 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.718589 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:23:50.718738 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.718599 2558 projected.go:196] Error preparing data for projected volume kube-api-access-n45fj for pod openshift-network-diagnostics/network-check-target-75zgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:50.718738 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.718655 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj podName:7247d778-01c8-4ada-aca2-e4c795c90ee8 nodeName:}" failed. No retries permitted until 2026-07-06 19:24:22.71863625 +0000 UTC m=+66.285166098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n45fj" (UniqueName: "kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj") pod "network-check-target-75zgj" (UID: "7247d778-01c8-4ada-aca2-e4c795c90ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:23:50.940151 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.940033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:50.959390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.959357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:50.959390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.959390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:50.959625 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:50.959357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:50.959625 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.959522 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:50.959625 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.959554 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:50.959781 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:50.959627 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:51.042970 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:51.042941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:52.959529 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:52.959493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:52.959979 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:52.959494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:52.959979 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:52.959634 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:23:52.959979 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:52.959666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:52.959979 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:52.959774 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-75zgj" podUID="7247d778-01c8-4ada-aca2-e4c795c90ee8" Jul 06 19:23:52.959979 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:52.959870 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4lgr" podUID="a74285f6-c63b-4576-9daf-fadb5c2788fb" Jul 06 19:23:53.255680 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.255604 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-242.ec2.internal" event="NodeReady" Jul 06 19:23:53.255828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.255774 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:23:53.301975 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.301939 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lgn64"] Jul 06 19:23:53.305197 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.305176 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pngvz"] Jul 06 19:23:53.305319 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.305301 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.308034 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.308015 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:23:53.308178 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.308050 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96fg5\"" Jul 06 19:23:53.308178 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.308047 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:23:53.308178 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.308121 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.308345 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.308200 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:23:53.310719 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.310702 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:23:53.310830 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.310736 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fr69w\"" Jul 06 19:23:53.311343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.311326 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:23:53.318223 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.318163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgn64"] Jul 06 19:23:53.318900 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.318880 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pngvz"] Jul 06 19:23:53.438617 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.438617 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b156647-348c-4719-96b3-74d206523ddf-tmp-dir\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.438789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8cr\" (UniqueName: \"kubernetes.io/projected/5b156647-348c-4719-96b3-74d206523ddf-kube-api-access-2k8cr\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.438789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d70f9b0-79d4-406c-9979-cab3a95f357a-cert\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.438789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8q4\" (UniqueName: \"kubernetes.io/projected/3d70f9b0-79d4-406c-9979-cab3a95f357a-kube-api-access-lm8q4\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.438789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.438773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b156647-348c-4719-96b3-74d206523ddf-config-volume\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.539858 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.539823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8cr\" (UniqueName: \"kubernetes.io/projected/5b156647-348c-4719-96b3-74d206523ddf-kube-api-access-2k8cr\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.540020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.539881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d70f9b0-79d4-406c-9979-cab3a95f357a-cert\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.540020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.539915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8q4\" (UniqueName: \"kubernetes.io/projected/3d70f9b0-79d4-406c-9979-cab3a95f357a-kube-api-access-lm8q4\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.540020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.539940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b156647-348c-4719-96b3-74d206523ddf-config-volume\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.540208 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.540176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.540252 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.540211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b156647-348c-4719-96b3-74d206523ddf-tmp-dir\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.540307 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:53.540289 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:23:53.540357 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:53.540352 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:23:54.040335737 +0000 UTC m=+37.606865588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:23:53.540547 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.540530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b156647-348c-4719-96b3-74d206523ddf-tmp-dir\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.541289 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.541272 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b156647-348c-4719-96b3-74d206523ddf-config-volume\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.548820 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.548787 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d70f9b0-79d4-406c-9979-cab3a95f357a-cert\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.551371 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.551343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8cr\" (UniqueName: \"kubernetes.io/projected/5b156647-348c-4719-96b3-74d206523ddf-kube-api-access-2k8cr\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:53.551485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.551416 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8q4\" (UniqueName: \"kubernetes.io/projected/3d70f9b0-79d4-406c-9979-cab3a95f357a-kube-api-access-lm8q4\") pod \"ingress-canary-lgn64\" (UID: \"3d70f9b0-79d4-406c-9979-cab3a95f357a\") " pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.615390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.615349 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgn64" Jul 06 19:23:53.757521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:53.757329 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgn64"] Jul 06 19:23:53.761009 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:23:53.760974 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d70f9b0_79d4_406c_9979_cab3a95f357a.slice/crio-b880451d9f5029480c2a260e0a037b18414250c7c5c9f0f97f351d7dcc78c151 WatchSource:0}: Error finding container b880451d9f5029480c2a260e0a037b18414250c7c5c9f0f97f351d7dcc78c151: Status 404 returned error can't find the container with id b880451d9f5029480c2a260e0a037b18414250c7c5c9f0f97f351d7dcc78c151 Jul 06 19:23:54.043771 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.043735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:54.044344 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:54.043844 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:23:54.044344 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:54.043897 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:23:55.04388403 +0000 UTC m=+38.610413861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:23:54.359811 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.359720 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="8d44b34b6e24db7afee01e5db4bf755097350cbb41981613794c91cdcfc9b53c" exitCode=0 Jul 06 19:23:54.359951 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.359808 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"8d44b34b6e24db7afee01e5db4bf755097350cbb41981613794c91cdcfc9b53c"} Jul 06 19:23:54.361477 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.361449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgn64" event={"ID":"3d70f9b0-79d4-406c-9979-cab3a95f357a","Type":"ContainerStarted","Data":"b880451d9f5029480c2a260e0a037b18414250c7c5c9f0f97f351d7dcc78c151"} Jul 06 19:23:54.959228 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.959192 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:23:54.959403 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.959193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:23:54.959403 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.959328 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:23:54.964091 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964066 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:23:54.964268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r6mk\"" Jul 06 19:23:54.964268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964164 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:23:54.964268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964077 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:23:54.964440 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964077 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mm8d\"" Jul 06 19:23:54.964493 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:54.964484 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:23:55.050711 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:55.050670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:55.051150 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:55.050798 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:23:55.051150 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:55.050859 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:23:57.050843023 +0000 UTC m=+40.617372853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:23:55.367889 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:55.367808 2558 generic.go:356] "Generic (PLEG): container finished" podID="ab409135-cd36-40fc-8a5b-120cb0469f9f" containerID="f9089de3aa6d4963ad77d10609141b6e55c9e3e35d5f63780a5cf460a7f62202" exitCode=0 Jul 06 19:23:55.368078 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:55.367891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerDied","Data":"f9089de3aa6d4963ad77d10609141b6e55c9e3e35d5f63780a5cf460a7f62202"} Jul 06 19:23:56.375414 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:56.375165 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" event={"ID":"ab409135-cd36-40fc-8a5b-120cb0469f9f","Type":"ContainerStarted","Data":"598cc8d7431b951872326160abc78513e81a7dff45ed32b03c3b0a03384a1a35"} Jul 06 19:23:56.398878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:56.398816 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mhrfm" podStartSLOduration=9.720071426 podStartE2EDuration="39.398792962s" totalImagesPullingTime="29.678721536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:56.397284304 +0000 UTC m=+39.963814158" watchObservedRunningTime="2026-07-06 19:23:56.398792962 +0000 UTC m=+39.965322815" Jul 06 19:23:56.526356 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:56.526278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:56.586686 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:56.586660 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:56.970793 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:56.970763 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:57.067546 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:57.067510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:23:57.067721 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:57.067656 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:23:57.067763 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:23:57.067721 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:24:01.067704132 +0000 UTC m=+44.634233963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:23:57.069485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:57.069452 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:23:57.379204 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:57.379164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgn64" event={"ID":"3d70f9b0-79d4-406c-9979-cab3a95f357a","Type":"ContainerStarted","Data":"20244cccb9af36e0fc1d5dadf59efce28b9a71bcc2dcad4377ec943e1bc513c7"} Jul 06 19:23:57.397158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:23:57.397083 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lgn64" podStartSLOduration=1.908516871 podStartE2EDuration="4.39706773s" totalImagesPullingTime="2.488550859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:23:57.396461648 +0000 UTC m=+40.962991502" watchObservedRunningTime="2026-07-06 19:23:57.39706773 +0000 UTC m=+40.963597582" Jul 06 19:24:00.421144 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:00.421109 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:24:00.482952 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:00.482919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:24:01.099432 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:01.099391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:24:01.099623 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:01.099517 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:01.099623 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:01.099573 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:24:09.099557256 +0000 UTC m=+52.666087087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:24:01.529026 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:01.528990 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:24:02.448011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:02.447978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:24:02.532213 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:02.532179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" limit=1024 Jul 06 19:24:09.152957 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:09.152914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:24:09.153478 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:09.153091 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:09.153478 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:09.153207 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:24:25.153186643 +0000 UTC m=+68.719716476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:24:18.355912 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:18.355883 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l888q" Jul 06 19:24:22.649273 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.649217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:24:22.649273 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.649291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:24:22.652407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.652384 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:24:22.652485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.652390 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:24:22.659736 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:22.659710 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:24:22.659861 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:22.659774 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:26.659756108 +0000 UTC m=+130.226285939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : secret "metrics-daemon-secret" not found Jul 06 19:24:22.663649 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.663622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a74285f6-c63b-4576-9daf-fadb5c2788fb-original-pull-secret\") pod \"global-pull-secret-syncer-w4lgr\" (UID: \"a74285f6-c63b-4576-9daf-fadb5c2788fb\") " pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:24:22.750072 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.750036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:24:22.753075 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.753055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:24:22.763652 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.763622 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:24:22.773444 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.773415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n45fj\" (UniqueName: \"kubernetes.io/projected/7247d778-01c8-4ada-aca2-e4c795c90ee8-kube-api-access-n45fj\") pod \"network-check-target-75zgj\" (UID: \"7247d778-01c8-4ada-aca2-e4c795c90ee8\") " pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:24:22.870833 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.870796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4lgr" Jul 06 19:24:22.881939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.881904 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r6mk\"" Jul 06 19:24:22.889463 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:22.889432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:24:23.009248 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:23.009217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4lgr"] Jul 06 19:24:23.012294 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:24:23.012257 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74285f6_c63b_4576_9daf_fadb5c2788fb.slice/crio-3cee549378adf7b1e4f56eb6b8848ef7c8817707cecbcc38e3c96eb2b4cf1fb4 WatchSource:0}: Error finding container 3cee549378adf7b1e4f56eb6b8848ef7c8817707cecbcc38e3c96eb2b4cf1fb4: Status 404 returned error can't find the container with id 3cee549378adf7b1e4f56eb6b8848ef7c8817707cecbcc38e3c96eb2b4cf1fb4 Jul 06 19:24:23.029657 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:23.029626 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-75zgj"] Jul 06 19:24:23.033576 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:24:23.033552 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7247d778_01c8_4ada_aca2_e4c795c90ee8.slice/crio-3d810a8db304fdd27b0eca02a33801705de42bea9370de18fa7d55e32259c4f7 WatchSource:0}: Error finding container 3d810a8db304fdd27b0eca02a33801705de42bea9370de18fa7d55e32259c4f7: Status 404 returned error can't find the container with id 3d810a8db304fdd27b0eca02a33801705de42bea9370de18fa7d55e32259c4f7 Jul 06 19:24:23.439816 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:23.439769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75zgj" event={"ID":"7247d778-01c8-4ada-aca2-e4c795c90ee8","Type":"ContainerStarted","Data":"3d810a8db304fdd27b0eca02a33801705de42bea9370de18fa7d55e32259c4f7"} Jul 06 19:24:23.440955 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:23.440933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4lgr" event={"ID":"a74285f6-c63b-4576-9daf-fadb5c2788fb","Type":"ContainerStarted","Data":"3cee549378adf7b1e4f56eb6b8848ef7c8817707cecbcc38e3c96eb2b4cf1fb4"} Jul 06 19:24:25.169149 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:25.169084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:24:25.169625 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:25.169264 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:25.169625 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:25.169347 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:24:57.169323954 +0000 UTC m=+100.735853810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:24:28.456699 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:28.456658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-75zgj" event={"ID":"7247d778-01c8-4ada-aca2-e4c795c90ee8","Type":"ContainerStarted","Data":"0b758049b795b115557ff5390a7a38fa66626dcb7bb4d21f33aaa6a610483063"} Jul 06 19:24:28.457272 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:28.456733 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:24:28.458132 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:28.458088 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4lgr" event={"ID":"a74285f6-c63b-4576-9daf-fadb5c2788fb","Type":"ContainerStarted","Data":"ecd19d19a15be97b55fea581703480d73070e603d64ed93d4effdda5f2c56d3f"} Jul 06 19:24:28.474325 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:28.474270 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-75zgj" podStartSLOduration=66.810272002 podStartE2EDuration="1m11.474255103s" totalImagesPullingTime="4.663983101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:28.474223143 +0000 UTC m=+72.040753006" watchObservedRunningTime="2026-07-06 19:24:28.474255103 +0000 UTC m=+72.040784947" Jul 06 19:24:28.489769 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:28.489715 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w4lgr" podStartSLOduration=66.801200048 podStartE2EDuration="1m11.489700045s" totalImagesPullingTime="4.688499997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:24:28.489640502 +0000 UTC m=+72.056170360" watchObservedRunningTime="2026-07-06 19:24:28.489700045 +0000 UTC m=+72.056229897" Jul 06 19:24:57.193532 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:57.193488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:24:57.193965 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:57.193606 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:24:57.193965 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:24:57.193659 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls podName:5b156647-348c-4719-96b3-74d206523ddf nodeName:}" failed. No retries permitted until 2026-07-06 19:26:01.193644921 +0000 UTC m=+164.760174752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls") pod "dns-default-pngvz" (UID: "5b156647-348c-4719-96b3-74d206523ddf") : secret "dns-default-metrics-tls" not found Jul 06 19:24:59.464032 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:24:59.464001 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-75zgj" Jul 06 19:25:26.688022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:26.687985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:25:26.688563 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:26.688165 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:25:26.688563 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:26.688251 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs podName:5de68b83-bea1-4e9d-aceb-c738ae92ec30 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:28.688236928 +0000 UTC m=+252.254766759 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs") pod "network-metrics-daemon-748sj" (UID: "5de68b83-bea1-4e9d-aceb-c738ae92ec30") : secret "metrics-daemon-secret" not found Jul 06 19:25:30.062784 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.062747 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vscg7"] Jul 06 19:25:30.064566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.064550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.067242 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.067212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:25:30.067242 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.067212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:25:30.067587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.067571 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:25:30.067687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.067592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:25:30.069252 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.069228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5q5vf\"" Jul 06 19:25:30.076067 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.076047 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:25:30.078167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.078149 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vscg7"] Jul 06 19:25:30.216120 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/648cbf48-438f-4721-9adf-3526105fc007-serving-cert\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.216295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgklg\" (UniqueName: \"kubernetes.io/projected/648cbf48-438f-4721-9adf-3526105fc007-kube-api-access-rgklg\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.216295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-tmp\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.216295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.216295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-snapshots\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.216295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.216276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317484 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/648cbf48-438f-4721-9adf-3526105fc007-serving-cert\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317484 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgklg\" (UniqueName: \"kubernetes.io/projected/648cbf48-438f-4721-9adf-3526105fc007-kube-api-access-rgklg\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317484 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-tmp\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-snapshots\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.317937 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.317911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-tmp\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.318209 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.318188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.318269 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.318220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/648cbf48-438f-4721-9adf-3526105fc007-snapshots\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.318394 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.318379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648cbf48-438f-4721-9adf-3526105fc007-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.319743 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.319726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/648cbf48-438f-4721-9adf-3526105fc007-serving-cert\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.327372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.327349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgklg\" (UniqueName: \"kubernetes.io/projected/648cbf48-438f-4721-9adf-3526105fc007-kube-api-access-rgklg\") pod \"insights-operator-5c847dcfc4-vscg7\" (UID: \"648cbf48-438f-4721-9adf-3526105fc007\") " pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.376404 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.376366 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" Jul 06 19:25:30.506827 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.506796 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vscg7"] Jul 06 19:25:30.509657 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:25:30.509630 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648cbf48_438f_4721_9adf_3526105fc007.slice/crio-cef7464fb3d317923dba8a10295125ec657848173524b5768d57054180c0527d WatchSource:0}: Error finding container cef7464fb3d317923dba8a10295125ec657848173524b5768d57054180c0527d: Status 404 returned error can't find the container with id cef7464fb3d317923dba8a10295125ec657848173524b5768d57054180c0527d Jul 06 19:25:30.612192 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.612093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" event={"ID":"648cbf48-438f-4721-9adf-3526105fc007","Type":"ContainerStarted","Data":"cef7464fb3d317923dba8a10295125ec657848173524b5768d57054180c0527d"} Jul 06 19:25:30.992022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.991985 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6"] Jul 06 19:25:30.994504 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.994481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:30.997462 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.997437 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:30.997579 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.997477 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4nxkp\"" Jul 06 19:25:30.998823 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.998807 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:25:30.998910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:30.998844 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:31.010263 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.010234 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6"] Jul 06 19:25:31.124488 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.124434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hxm5\" (UniqueName: \"kubernetes.io/projected/daff0713-1d6f-4f76-87a8-6e52cce3f457-kube-api-access-6hxm5\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.124488 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.124492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.225399 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.225360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hxm5\" (UniqueName: \"kubernetes.io/projected/daff0713-1d6f-4f76-87a8-6e52cce3f457-kube-api-access-6hxm5\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.225588 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.225412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.225588 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:31.225540 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:31.225702 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:31.225606 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:31.725588702 +0000 UTC m=+135.292118547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:31.235231 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.235202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hxm5\" (UniqueName: \"kubernetes.io/projected/daff0713-1d6f-4f76-87a8-6e52cce3f457-kube-api-access-6hxm5\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.728795 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.728690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:31.728795 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:31.728777 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:31.729016 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:31.728856 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:32.728838075 +0000 UTC m=+136.295367925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:31.899986 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.899952 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ph8hj"] Jul 06 19:25:31.901959 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.901933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:31.905150 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.905125 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:31.905288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.905137 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:25:31.905288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.905279 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:31.905404 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.905132 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:25:31.906764 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.906743 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vx6tq\"" Jul 06 19:25:31.912326 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.912306 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:25:31.917070 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:31.917042 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ph8hj"] Jul 06 19:25:32.031011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.030920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-config\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.031011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.030981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-serving-cert\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.031011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.031007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-trusted-ca\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.031339 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.031036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclnz\" (UniqueName: \"kubernetes.io/projected/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-kube-api-access-gclnz\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.131921 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.131884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclnz\" (UniqueName: \"kubernetes.io/projected/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-kube-api-access-gclnz\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.132469 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.131963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-config\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.132469 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.132002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-serving-cert\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.132469 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.132033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-trusted-ca\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.133351 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.133325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-config\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.133473 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.133360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-trusted-ca\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.138878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.138850 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-serving-cert\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.144456 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.144425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclnz\" (UniqueName: \"kubernetes.io/projected/bc1bbfc5-6261-4d4f-9ded-9ac75f074a56-kube-api-access-gclnz\") pod \"console-operator-68b757fb67-ph8hj\" (UID: \"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56\") " pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.213510 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.213472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:32.531276 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.531240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-ph8hj"] Jul 06 19:25:32.534647 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:25:32.534620 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1bbfc5_6261_4d4f_9ded_9ac75f074a56.slice/crio-3ec89d571899cf18a4fe350ebf196cdacc0fba05ad69b64727d201e3df9e31f7 WatchSource:0}: Error finding container 3ec89d571899cf18a4fe350ebf196cdacc0fba05ad69b64727d201e3df9e31f7: Status 404 returned error can't find the container with id 3ec89d571899cf18a4fe350ebf196cdacc0fba05ad69b64727d201e3df9e31f7 Jul 06 19:25:32.618670 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.618638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" event={"ID":"648cbf48-438f-4721-9adf-3526105fc007","Type":"ContainerStarted","Data":"e306464762a03c529d3f379521760d8b9cff0541c2c47291881230006310289f"} Jul 06 19:25:32.619805 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.619783 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" event={"ID":"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56","Type":"ContainerStarted","Data":"3ec89d571899cf18a4fe350ebf196cdacc0fba05ad69b64727d201e3df9e31f7"} Jul 06 19:25:32.642992 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.642942 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" podStartSLOduration=0.725596036 podStartE2EDuration="2.642926956s" totalImagesPullingTime="1.91733092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:32.642327136 +0000 UTC m=+136.208856991" watchObservedRunningTime="2026-07-06 19:25:32.642926956 +0000 UTC m=+136.209456812" Jul 06 19:25:32.737561 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:32.737452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:32.737721 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:32.737580 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:32.737721 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:32.737643 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:34.7376269 +0000 UTC m=+138.304156746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:33.683874 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.683838 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:25:33.686069 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.686041 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.689477 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.689204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5642j\"" Jul 06 19:25:33.689477 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.689271 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:25:33.689477 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.689289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:25:33.689872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.689852 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:25:33.695587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.695394 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:25:33.707996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.707961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:25:33.846371 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846371 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjmsb\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.846593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.846541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.947707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.947707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947649 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.947707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.947707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjmsb\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.947841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:33.947929 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:33.947950 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:33.948038 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:33.948005 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:34.447984168 +0000 UTC m=+138.014514005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:33.948407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.948250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948470 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.948407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.948808 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.948781 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.950310 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.950286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.950406 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.950335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.958242 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.958206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:33.958372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:33.958271 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjmsb\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:34.451106 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.451046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:34.451288 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:34.451221 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:34.451288 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:34.451244 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:34.451384 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:34.451308 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:35.45129165 +0000 UTC m=+139.017821502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:34.754710 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.754676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:34.755050 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:34.754862 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:34.755050 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:34.754934 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:38.75491588 +0000 UTC m=+142.321445714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:34.885113 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.885064 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jjsmr"] Jul 06 19:25:34.886904 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.886888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:34.889616 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.889593 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:25:34.889789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.889756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:25:34.889879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.889859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hv5fq\"" Jul 06 19:25:34.914451 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:34.914419 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjsmr"] Jul 06 19:25:35.057882 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.057843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1feabb15-7b20-4f91-994e-f8060d8f9544-data-volume\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.057882 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.057884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.058121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.057909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.058121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.057969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrdl\" (UniqueName: \"kubernetes.io/projected/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-api-access-vtrdl\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.058121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.058037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1feabb15-7b20-4f91-994e-f8060d8f9544-crio-socket\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159254 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1feabb15-7b20-4f91-994e-f8060d8f9544-data-volume\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159254 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159275 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrdl\" (UniqueName: \"kubernetes.io/projected/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-api-access-vtrdl\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1feabb15-7b20-4f91-994e-f8060d8f9544-crio-socket\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.159557 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.159462 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:35.159557 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.159542 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:35.659520119 +0000 UTC m=+139.226049970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:35.159641 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.159549 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:35.159641 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.159609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:35.659594464 +0000 UTC m=+139.226124335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : configmap "kube-rbac-proxy" not found Jul 06 19:25:35.159641 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.159622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1feabb15-7b20-4f91-994e-f8060d8f9544-crio-socket\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.160167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.160149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1feabb15-7b20-4f91-994e-f8060d8f9544-data-volume\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.170013 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.169985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrdl\" (UniqueName: \"kubernetes.io/projected/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-api-access-vtrdl\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.461670 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.461629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:35.461857 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.461791 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:35.461857 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.461813 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:35.461932 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.461879 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:37.461862979 +0000 UTC m=+141.028392814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:35.628657 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.628629 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/0.log" Jul 06 19:25:35.628818 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.628673 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc1bbfc5-6261-4d4f-9ded-9ac75f074a56" containerID="6d827dc387ee6726c3acc61a171dbe1728aa12c43d8b04637c53dc365cc358d9" exitCode=255 Jul 06 19:25:35.628818 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.628743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" event={"ID":"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56","Type":"ContainerDied","Data":"6d827dc387ee6726c3acc61a171dbe1728aa12c43d8b04637c53dc365cc358d9"} Jul 06 19:25:35.629019 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.629004 2558 scope.go:117] "RemoveContainer" containerID="6d827dc387ee6726c3acc61a171dbe1728aa12c43d8b04637c53dc365cc358d9" Jul 06 19:25:35.664159 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.664121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.664297 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.664162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:35.664297 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.664240 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:35.664373 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.664305 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:35.664373 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.664321 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:36.66429156 +0000 UTC m=+140.230821415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : configmap "kube-rbac-proxy" not found Jul 06 19:25:35.664373 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:35.664353 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:36.664341552 +0000 UTC m=+140.230871383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:35.872756 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.872725 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n"] Jul 06 19:25:35.874587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.874568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:35.877387 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.877363 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:25:35.877518 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.877404 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xlbbq\"" Jul 06 19:25:35.877518 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.877421 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:35.877601 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.877541 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:35.877636 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.877621 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:25:35.895628 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.895597 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n"] Jul 06 19:25:35.966252 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.966193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r72rv\" (UniqueName: \"kubernetes.io/projected/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-kube-api-access-r72rv\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:35.966426 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.966330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:35.966426 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:35.966353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.067752 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.067680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.067891 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.067747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r72rv\" (UniqueName: \"kubernetes.io/projected/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-kube-api-access-r72rv\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.067891 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.067827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.068443 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.068416 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.069847 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.069826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.081318 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.081292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r72rv\" (UniqueName: \"kubernetes.io/projected/fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56-kube-api-access-r72rv\") pod \"kube-storage-version-migrator-operator-846bf668f7-mgb4n\" (UID: \"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.183065 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.183008 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" Jul 06 19:25:36.308596 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.308561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n"] Jul 06 19:25:36.311555 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:25:36.311528 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6cbbf0_ff55_4ca7_a28d_5393fe1f7f56.slice/crio-aa7607fcd77dfe84172b25c45d1bda83e25e56fb1dd5821764a119f1a700d675 WatchSource:0}: Error finding container aa7607fcd77dfe84172b25c45d1bda83e25e56fb1dd5821764a119f1a700d675: Status 404 returned error can't find the container with id aa7607fcd77dfe84172b25c45d1bda83e25e56fb1dd5821764a119f1a700d675 Jul 06 19:25:36.633177 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633150 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:25:36.633572 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633556 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/0.log" Jul 06 19:25:36.633617 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633593 2558 generic.go:356] "Generic (PLEG): container finished" podID="bc1bbfc5-6261-4d4f-9ded-9ac75f074a56" containerID="f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a" exitCode=255 Jul 06 19:25:36.633687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633667 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" event={"ID":"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56","Type":"ContainerDied","Data":"f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a"} Jul 06 19:25:36.633740 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633721 2558 scope.go:117] "RemoveContainer" containerID="6d827dc387ee6726c3acc61a171dbe1728aa12c43d8b04637c53dc365cc358d9" Jul 06 19:25:36.633942 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.633922 2558 scope.go:117] "RemoveContainer" containerID="f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a" Jul 06 19:25:36.634174 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:36.634151 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ph8hj_openshift-console-operator(bc1bbfc5-6261-4d4f-9ded-9ac75f074a56)\"" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" podUID="bc1bbfc5-6261-4d4f-9ded-9ac75f074a56" Jul 06 19:25:36.634963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.634941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" event={"ID":"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56","Type":"ContainerStarted","Data":"aa7607fcd77dfe84172b25c45d1bda83e25e56fb1dd5821764a119f1a700d675"} Jul 06 19:25:36.673005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.672972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:36.673005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:36.673006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:36.673231 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:36.673093 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:36.673231 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:36.673171 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:36.673231 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:36.673178 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:38.673161249 +0000 UTC m=+142.239691082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : configmap "kube-rbac-proxy" not found Jul 06 19:25:36.673231 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:36.673214 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:38.673201547 +0000 UTC m=+142.239731378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:37.067280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:37.067206 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vcnb6_dc354b56-0837-4b6a-9b8a-cef809dded26/dns-node-resolver/0.log" Jul 06 19:25:37.480195 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:37.480151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:37.480344 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:37.480313 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:37.480344 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:37.480338 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:37.480441 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:37.480400 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:41.480383194 +0000 UTC m=+145.046913031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:37.639612 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:37.639581 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:25:37.640004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:37.639983 2558 scope.go:117] "RemoveContainer" containerID="f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a" Jul 06 19:25:37.640194 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:37.640173 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ph8hj_openshift-console-operator(bc1bbfc5-6261-4d4f-9ded-9ac75f074a56)\"" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" podUID="bc1bbfc5-6261-4d4f-9ded-9ac75f074a56" Jul 06 19:25:37.869029 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:37.869005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-677sr_a0773a41-2e3f-4be6-afe2-f044553267d5/node-ca/0.log" Jul 06 19:25:38.644603 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.644564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" event={"ID":"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56","Type":"ContainerStarted","Data":"f985ebc3efa5505fc5495bb40b04695dfbb9027f9dbed616ed6238aa6074350e"} Jul 06 19:25:38.673535 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.673483 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" podStartSLOduration=1.459593782 podStartE2EDuration="3.67346749s" totalImagesPullingTime="2.213873708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:38.671686965 +0000 UTC m=+142.238216906" watchObservedRunningTime="2026-07-06 19:25:38.67346749 +0000 UTC m=+142.239997366" Jul 06 19:25:38.691268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.691235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:38.691268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.691271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:38.691463 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.691381 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:38.691507 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.691473 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:42.691452873 +0000 UTC m=+146.257982705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : configmap "kube-rbac-proxy" not found Jul 06 19:25:38.691507 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.691387 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:38.691578 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.691511 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:42.69150187 +0000 UTC m=+146.258031704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:38.792289 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.792195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:38.792465 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.792406 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:38.792532 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:38.792479 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:46.792461205 +0000 UTC m=+150.358991053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:38.865871 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:38.865847 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgn64_3d70f9b0-79d4-406c-9979-cab3a95f357a/serve-healthcheck-canary/0.log" Jul 06 19:25:39.332971 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.332927 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s"] Jul 06 19:25:39.334920 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.334903 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" Jul 06 19:25:39.338310 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.338289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ngv97\"" Jul 06 19:25:39.347604 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.347578 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s"] Jul 06 19:25:39.498726 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.498680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94k6v\" (UniqueName: \"kubernetes.io/projected/ca315d92-29f1-43ef-9c54-9a36dd9b27c9-kube-api-access-94k6v\") pod \"network-check-source-989f8b8dc-hvd2s\" (UID: \"ca315d92-29f1-43ef-9c54-9a36dd9b27c9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" Jul 06 19:25:39.545954 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.545919 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56"] Jul 06 19:25:39.548165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.548144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" Jul 06 19:25:39.551012 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.550993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:39.551012 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.551001 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:25:39.551314 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.551300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9ctbs\"" Jul 06 19:25:39.559353 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.559324 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56"] Jul 06 19:25:39.599779 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.599681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94k6v\" (UniqueName: \"kubernetes.io/projected/ca315d92-29f1-43ef-9c54-9a36dd9b27c9-kube-api-access-94k6v\") pod \"network-check-source-989f8b8dc-hvd2s\" (UID: \"ca315d92-29f1-43ef-9c54-9a36dd9b27c9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" Jul 06 19:25:39.611250 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.611220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94k6v\" (UniqueName: \"kubernetes.io/projected/ca315d92-29f1-43ef-9c54-9a36dd9b27c9-kube-api-access-94k6v\") pod \"network-check-source-989f8b8dc-hvd2s\" (UID: \"ca315d92-29f1-43ef-9c54-9a36dd9b27c9\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" Jul 06 19:25:39.643284 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.643248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" Jul 06 19:25:39.700728 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.700697 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsnz\" (UniqueName: \"kubernetes.io/projected/0f09484b-4aed-4ec8-b2b6-4fff9d387b75-kube-api-access-6wsnz\") pod \"migrator-d57d58cc9-blk56\" (UID: \"0f09484b-4aed-4ec8-b2b6-4fff9d387b75\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" Jul 06 19:25:39.771135 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.771077 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s"] Jul 06 19:25:39.775200 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:25:39.775169 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca315d92_29f1_43ef_9c54_9a36dd9b27c9.slice/crio-8d29a5cf95b70c2846080d613bc474b16732c1e744faaeb503d64e1d312afb1a WatchSource:0}: Error finding container 8d29a5cf95b70c2846080d613bc474b16732c1e744faaeb503d64e1d312afb1a: Status 404 returned error can't find the container with id 8d29a5cf95b70c2846080d613bc474b16732c1e744faaeb503d64e1d312afb1a Jul 06 19:25:39.801500 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.801465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsnz\" (UniqueName: \"kubernetes.io/projected/0f09484b-4aed-4ec8-b2b6-4fff9d387b75-kube-api-access-6wsnz\") pod \"migrator-d57d58cc9-blk56\" (UID: \"0f09484b-4aed-4ec8-b2b6-4fff9d387b75\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" Jul 06 19:25:39.811044 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.811016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsnz\" (UniqueName: \"kubernetes.io/projected/0f09484b-4aed-4ec8-b2b6-4fff9d387b75-kube-api-access-6wsnz\") pod \"migrator-d57d58cc9-blk56\" (UID: \"0f09484b-4aed-4ec8-b2b6-4fff9d387b75\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" Jul 06 19:25:39.857372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.857286 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" Jul 06 19:25:39.987585 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:39.987552 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56"] Jul 06 19:25:39.991024 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:25:39.991002 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f09484b_4aed_4ec8_b2b6_4fff9d387b75.slice/crio-495bc0f58b1ebbff8da90e4bb1b4fafed826af17cae7e50c660e5a0cac72e097 WatchSource:0}: Error finding container 495bc0f58b1ebbff8da90e4bb1b4fafed826af17cae7e50c660e5a0cac72e097: Status 404 returned error can't find the container with id 495bc0f58b1ebbff8da90e4bb1b4fafed826af17cae7e50c660e5a0cac72e097 Jul 06 19:25:40.651725 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:40.651680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" event={"ID":"0f09484b-4aed-4ec8-b2b6-4fff9d387b75","Type":"ContainerStarted","Data":"495bc0f58b1ebbff8da90e4bb1b4fafed826af17cae7e50c660e5a0cac72e097"} Jul 06 19:25:40.653455 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:40.653418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" event={"ID":"ca315d92-29f1-43ef-9c54-9a36dd9b27c9","Type":"ContainerStarted","Data":"094203e66670a4c2c1088250af5cd88de6e65bd99aecc076725619f120822986"} Jul 06 19:25:40.653620 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:40.653473 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" event={"ID":"ca315d92-29f1-43ef-9c54-9a36dd9b27c9","Type":"ContainerStarted","Data":"8d29a5cf95b70c2846080d613bc474b16732c1e744faaeb503d64e1d312afb1a"} Jul 06 19:25:40.681946 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:40.681887 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hvd2s" podStartSLOduration=1.681872005 podStartE2EDuration="1.681872005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:40.681365203 +0000 UTC m=+144.247895058" watchObservedRunningTime="2026-07-06 19:25:40.681872005 +0000 UTC m=+144.248401879" Jul 06 19:25:41.515194 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:41.515158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:41.515577 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:41.515288 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:41.515577 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:41.515300 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:41.515577 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:41.515355 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:49.515336942 +0000 UTC m=+153.081866787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:41.659848 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:41.659805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" event={"ID":"0f09484b-4aed-4ec8-b2b6-4fff9d387b75","Type":"ContainerStarted","Data":"56e31ba251382e7a22f7de1837a100530a66e1ee5c78ae9bddca9e5859450c4b"} Jul 06 19:25:41.659992 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:41.659867 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" event={"ID":"0f09484b-4aed-4ec8-b2b6-4fff9d387b75","Type":"ContainerStarted","Data":"4f779b00199a5079f583af9c3b41419e9b0d9754fc2d2cf84683cbebcaafcaee"} Jul 06 19:25:42.214223 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:42.214179 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:42.214423 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:42.214257 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:42.214674 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:42.214657 2558 scope.go:117] "RemoveContainer" containerID="f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a" Jul 06 19:25:42.214829 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:42.214811 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-ph8hj_openshift-console-operator(bc1bbfc5-6261-4d4f-9ded-9ac75f074a56)\"" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" podUID="bc1bbfc5-6261-4d4f-9ded-9ac75f074a56" Jul 06 19:25:42.724447 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:42.724391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:42.724447 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:42.724450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:42.724910 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:42.724518 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:25:42.724910 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:42.724562 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:42.724910 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:42.724582 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:50.724567797 +0000 UTC m=+154.291097627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : configmap "kube-rbac-proxy" not found Jul 06 19:25:42.724910 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:42.724652 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:50.724634485 +0000 UTC m=+154.291164320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:46.860433 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:46.860396 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:25:46.860940 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:46.860610 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:25:46.860940 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:46.860701 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls podName:daff0713-1d6f-4f76-87a8-6e52cce3f457 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:02.860677542 +0000 UTC m=+166.427207375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-96mq6" (UID: "daff0713-1d6f-4f76-87a8-6e52cce3f457") : secret "samples-operator-tls" not found Jul 06 19:25:49.584698 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:49.584653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:25:49.585124 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:49.584804 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:25:49.585124 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:49.584823 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d456b57f6-txrzh: secret "image-registry-tls" not found Jul 06 19:25:49.585124 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:49.584882 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls podName:d6986465-3698-4e22-932e-6df550f2b971 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:05.584863983 +0000 UTC m=+169.151393835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls") pod "image-registry-7d456b57f6-txrzh" (UID: "d6986465-3698-4e22-932e-6df550f2b971") : secret "image-registry-tls" not found Jul 06 19:25:50.793709 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:50.793675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:50.793709 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:50.793714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:50.794188 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:50.793841 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:25:50.794188 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:50.793893 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls podName:1feabb15-7b20-4f91-994e-f8060d8f9544 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:06.793880025 +0000 UTC m=+170.360409855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jjsmr" (UID: "1feabb15-7b20-4f91-994e-f8060d8f9544") : secret "insights-runtime-extractor-tls" not found Jul 06 19:25:50.794265 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:50.794233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1feabb15-7b20-4f91-994e-f8060d8f9544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:25:55.959739 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:55.959703 2558 scope.go:117] "RemoveContainer" containerID="f3ec579583588bc4a430b37a1872d2927d7647a2740dbeca95d663b37426032a" Jul 06 19:25:56.321248 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:56.321212 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pngvz" podUID="5b156647-348c-4719-96b3-74d206523ddf" Jul 06 19:25:56.707510 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.707484 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:25:56.707745 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.707579 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pngvz" Jul 06 19:25:56.707745 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.707610 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" event={"ID":"bc1bbfc5-6261-4d4f-9ded-9ac75f074a56","Type":"ContainerStarted","Data":"0ff52c21c068d8590daac614098026b0c15bee749e7f0cd110866c4311dab1e5"} Jul 06 19:25:56.707896 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.707880 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:56.712588 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.712565 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" Jul 06 19:25:56.729116 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.729047 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blk56" podStartSLOduration=16.752533167 podStartE2EDuration="17.729032671s" totalImagesPullingTime="976.499504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:41.678630433 +0000 UTC m=+145.245160286" watchObservedRunningTime="2026-07-06 19:25:56.729032671 +0000 UTC m=+160.295562545" Jul 06 19:25:56.729641 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:25:56.729618 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-ph8hj" podStartSLOduration=23.615959229 podStartE2EDuration="25.72961046s" totalImagesPullingTime="2.113651231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:56.72724956 +0000 UTC m=+160.293779413" watchObservedRunningTime="2026-07-06 19:25:56.72961046 +0000 UTC m=+160.296140312" Jul 06 19:25:57.984619 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:25:57.984555 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-748sj" podUID="5de68b83-bea1-4e9d-aceb-c738ae92ec30" Jul 06 19:26:01.272329 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.272289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:26:01.274650 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.274627 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b156647-348c-4719-96b3-74d206523ddf-metrics-tls\") pod \"dns-default-pngvz\" (UID: \"5b156647-348c-4719-96b3-74d206523ddf\") " pod="openshift-dns/dns-default-pngvz" Jul 06 19:26:01.512219 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.512185 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fr69w\"" Jul 06 19:26:01.518735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.518715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pngvz" Jul 06 19:26:01.699747 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.699715 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pngvz"] Jul 06 19:26:01.703141 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:01.703090 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b156647_348c_4719_96b3_74d206523ddf.slice/crio-9630a4e9da694359599a40f9abb3ec80a7724922d7702a209ecef5a645925e70 WatchSource:0}: Error finding container 9630a4e9da694359599a40f9abb3ec80a7724922d7702a209ecef5a645925e70: Status 404 returned error can't find the container with id 9630a4e9da694359599a40f9abb3ec80a7724922d7702a209ecef5a645925e70 Jul 06 19:26:01.726390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:01.726361 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pngvz" event={"ID":"5b156647-348c-4719-96b3-74d206523ddf","Type":"ContainerStarted","Data":"9630a4e9da694359599a40f9abb3ec80a7724922d7702a209ecef5a645925e70"} Jul 06 19:26:02.886917 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:02.886876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:26:02.889452 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:02.889424 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/daff0713-1d6f-4f76-87a8-6e52cce3f457-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-96mq6\" (UID: \"daff0713-1d6f-4f76-87a8-6e52cce3f457\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:26:03.103234 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.103195 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" Jul 06 19:26:03.475019 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.474989 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6"] Jul 06 19:26:03.734979 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.734945 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pngvz" event={"ID":"5b156647-348c-4719-96b3-74d206523ddf","Type":"ContainerStarted","Data":"d2c026565e92871c7b950a29139882fe712dba31c65da3e365b7a4e47d62a26a"} Jul 06 19:26:03.735221 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.735029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pngvz" event={"ID":"5b156647-348c-4719-96b3-74d206523ddf","Type":"ContainerStarted","Data":"07a48d1d4305dadcd403053fdabf5ea0896b33fc1c6a28cbcde9670e3ef416b6"} Jul 06 19:26:03.735221 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.735060 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pngvz" Jul 06 19:26:03.736239 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.736211 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" event={"ID":"daff0713-1d6f-4f76-87a8-6e52cce3f457","Type":"ContainerStarted","Data":"6e1f88f2177e76ec7abc70ec677ba77a8fdbb7a7d0920eaec99e5ec911eaaaf3"} Jul 06 19:26:03.762992 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:03.762932 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pngvz" podStartSLOduration=129.079928422 podStartE2EDuration="2m10.76291608s" totalImagesPullingTime="1.682987658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:03.760633934 +0000 UTC m=+167.327163800" watchObservedRunningTime="2026-07-06 19:26:03.76291608 +0000 UTC m=+167.329445933" Jul 06 19:26:05.607546 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.607509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:05.609944 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.609905 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"image-registry-7d456b57f6-txrzh\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:05.745000 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.744965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" event={"ID":"daff0713-1d6f-4f76-87a8-6e52cce3f457","Type":"ContainerStarted","Data":"27718df364b72f50a8cb78aa45c35a332fce94bcde08225f1da4de3f22a7872a"} Jul 06 19:26:05.745194 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.745024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" event={"ID":"daff0713-1d6f-4f76-87a8-6e52cce3f457","Type":"ContainerStarted","Data":"4c5dd764a142a2534d04e8a704ef71b8e0503a57bcaf676edeb14302554acab1"} Jul 06 19:26:05.780307 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.780250 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-96mq6" podStartSLOduration=34.242045394 podStartE2EDuration="35.780231143s" totalImagesPullingTime="1.538185749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:05.779596289 +0000 UTC m=+169.346126144" watchObservedRunningTime="2026-07-06 19:26:05.780231143 +0000 UTC m=+169.346761013" Jul 06 19:26:05.798011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.797974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:05.945778 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:05.945742 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:26:05.948553 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:05.948527 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6986465_3698_4e22_932e_6df550f2b971.slice/crio-9854fbc13320d11ef0a56e4be7f2e027f60963c42671542d7d828872ed03dcd5 WatchSource:0}: Error finding container 9854fbc13320d11ef0a56e4be7f2e027f60963c42671542d7d828872ed03dcd5: Status 404 returned error can't find the container with id 9854fbc13320d11ef0a56e4be7f2e027f60963c42671542d7d828872ed03dcd5 Jul 06 19:26:06.749735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.749703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" event={"ID":"d6986465-3698-4e22-932e-6df550f2b971","Type":"ContainerStarted","Data":"55a4944e02ddb1bd14a5eadfafefa15b2e9069b98f03c7a0ebbaf573572cef51"} Jul 06 19:26:06.749735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.749749 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" event={"ID":"d6986465-3698-4e22-932e-6df550f2b971","Type":"ContainerStarted","Data":"9854fbc13320d11ef0a56e4be7f2e027f60963c42671542d7d828872ed03dcd5"} Jul 06 19:26:06.750293 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.749783 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:06.773774 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.773721 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" podStartSLOduration=33.773703158000004 podStartE2EDuration="33.773703158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.772552921 +0000 UTC m=+170.339082774" watchObservedRunningTime="2026-07-06 19:26:06.773703158 +0000 UTC m=+170.340233010" Jul 06 19:26:06.820785 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.820750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:26:06.823170 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.823136 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1feabb15-7b20-4f91-994e-f8060d8f9544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jjsmr\" (UID: \"1feabb15-7b20-4f91-994e-f8060d8f9544\") " pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:26:06.996130 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:06.996077 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jjsmr" Jul 06 19:26:07.135692 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:07.135649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jjsmr"] Jul 06 19:26:07.138504 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:07.138475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1feabb15_7b20_4f91_994e_f8060d8f9544.slice/crio-17fe41645c244f045d8676f27149ff86e8e9d07716c7a4380acb90ea4cc983da WatchSource:0}: Error finding container 17fe41645c244f045d8676f27149ff86e8e9d07716c7a4380acb90ea4cc983da: Status 404 returned error can't find the container with id 17fe41645c244f045d8676f27149ff86e8e9d07716c7a4380acb90ea4cc983da Jul 06 19:26:07.755883 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:07.755846 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjsmr" event={"ID":"1feabb15-7b20-4f91-994e-f8060d8f9544","Type":"ContainerStarted","Data":"17fe41645c244f045d8676f27149ff86e8e9d07716c7a4380acb90ea4cc983da"} Jul 06 19:26:08.467030 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.466978 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd"] Jul 06 19:26:08.469967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.469928 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-bw8z8"] Jul 06 19:26:08.470136 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.470076 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:08.472719 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.472694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:08.473064 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.473045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:26:08.473177 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.473123 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w7lhd\"" Jul 06 19:26:08.475681 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.475661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:26:08.475681 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.475675 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d4tnn\"" Jul 06 19:26:08.475959 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.475941 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:26:08.495004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.494936 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd"] Jul 06 19:26:08.496262 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.496238 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:26:08.512392 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.512348 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-bw8z8"] Jul 06 19:26:08.535773 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.535734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6sdh\" (UniqueName: \"kubernetes.io/projected/aaa7b8f6-e959-4ca7-a50f-aa44a07bd147-kube-api-access-t6sdh\") pod \"downloads-685bfb5f64-bw8z8\" (UID: \"aaa7b8f6-e959-4ca7-a50f-aa44a07bd147\") " pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:08.536162 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.535793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c545a82-3b51-46e0-9383-99294291dcf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zwsnd\" (UID: \"0c545a82-3b51-46e0-9383-99294291dcf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:08.567593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.567561 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f66654587-5vwn2"] Jul 06 19:26:08.570669 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.570645 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.589198 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.589167 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f66654587-5vwn2"] Jul 06 19:26:08.636560 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-image-registry-private-configuration\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-tls\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8c7c5df-2c1c-4664-843f-f48095376af8-ca-trust-extracted\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636610 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-trusted-ca\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-certificates\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6sdh\" (UniqueName: \"kubernetes.io/projected/aaa7b8f6-e959-4ca7-a50f-aa44a07bd147-kube-api-access-t6sdh\") pod \"downloads-685bfb5f64-bw8z8\" (UID: \"aaa7b8f6-e959-4ca7-a50f-aa44a07bd147\") " pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:08.636733 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c545a82-3b51-46e0-9383-99294291dcf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zwsnd\" (UID: \"0c545a82-3b51-46e0-9383-99294291dcf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:08.637018 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-installation-pull-secrets\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.637018 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-bound-sa-token\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.637018 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.636817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4vbl\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-kube-api-access-q4vbl\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.639524 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.639496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0c545a82-3b51-46e0-9383-99294291dcf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zwsnd\" (UID: \"0c545a82-3b51-46e0-9383-99294291dcf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:08.647003 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.646970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6sdh\" (UniqueName: \"kubernetes.io/projected/aaa7b8f6-e959-4ca7-a50f-aa44a07bd147-kube-api-access-t6sdh\") pod \"downloads-685bfb5f64-bw8z8\" (UID: \"aaa7b8f6-e959-4ca7-a50f-aa44a07bd147\") " pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:08.737544 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-trusted-ca\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737544 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-certificates\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737544 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-installation-pull-secrets\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737826 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-bound-sa-token\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737826 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4vbl\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-kube-api-access-q4vbl\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737826 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-image-registry-private-configuration\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737997 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-tls\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.737997 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.737863 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8c7c5df-2c1c-4664-843f-f48095376af8-ca-trust-extracted\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.738508 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.738305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8c7c5df-2c1c-4664-843f-f48095376af8-ca-trust-extracted\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.738638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.738505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-certificates\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.738638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.738513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8c7c5df-2c1c-4664-843f-f48095376af8-trusted-ca\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.740273 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.740252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-installation-pull-secrets\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.740421 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.740401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-registry-tls\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.740492 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.740474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8c7c5df-2c1c-4664-843f-f48095376af8-image-registry-private-configuration\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.753722 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.753685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-bound-sa-token\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.753887 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.753743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4vbl\" (UniqueName: \"kubernetes.io/projected/d8c7c5df-2c1c-4664-843f-f48095376af8-kube-api-access-q4vbl\") pod \"image-registry-f66654587-5vwn2\" (UID: \"d8c7c5df-2c1c-4664-843f-f48095376af8\") " pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.783323 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.783282 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:08.789485 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.789455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:08.880431 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.880381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:08.959935 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:08.959902 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:26:10.924243 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:10.924117 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-bw8z8"] Jul 06 19:26:10.927055 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:10.927022 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa7b8f6_e959_4ca7_a50f_aa44a07bd147.slice/crio-c1aada5216276de16b761ae4896f934190bf91dc43c54bc48a2ec1342e1691cd WatchSource:0}: Error finding container c1aada5216276de16b761ae4896f934190bf91dc43c54bc48a2ec1342e1691cd: Status 404 returned error can't find the container with id c1aada5216276de16b761ae4896f934190bf91dc43c54bc48a2ec1342e1691cd Jul 06 19:26:10.944588 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:10.944555 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd"] Jul 06 19:26:10.946813 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:10.946788 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c545a82_3b51_46e0_9383_99294291dcf7.slice/crio-2d313ecdf5400c3c5cfcc6e1ad9f11c48b4e70f7252f7cc91d3ade8f80c13ec8 WatchSource:0}: Error finding container 2d313ecdf5400c3c5cfcc6e1ad9f11c48b4e70f7252f7cc91d3ade8f80c13ec8: Status 404 returned error can't find the container with id 2d313ecdf5400c3c5cfcc6e1ad9f11c48b4e70f7252f7cc91d3ade8f80c13ec8 Jul 06 19:26:10.962012 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:10.961984 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c7c5df_2c1c_4664_843f_f48095376af8.slice/crio-f90ad84ae738bb315ee6259ddf1829edfe1110c320eeae93e69920da7cc7ea5f WatchSource:0}: Error finding container f90ad84ae738bb315ee6259ddf1829edfe1110c320eeae93e69920da7cc7ea5f: Status 404 returned error can't find the container with id f90ad84ae738bb315ee6259ddf1829edfe1110c320eeae93e69920da7cc7ea5f Jul 06 19:26:10.969366 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:10.969343 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f66654587-5vwn2"] Jul 06 19:26:11.774282 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.773676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f66654587-5vwn2" event={"ID":"d8c7c5df-2c1c-4664-843f-f48095376af8","Type":"ContainerStarted","Data":"8458164875c40fd193f41f594c6f2b81630b09356c04af6859d8c087421224d2"} Jul 06 19:26:11.774282 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.773740 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f66654587-5vwn2" event={"ID":"d8c7c5df-2c1c-4664-843f-f48095376af8","Type":"ContainerStarted","Data":"f90ad84ae738bb315ee6259ddf1829edfe1110c320eeae93e69920da7cc7ea5f"} Jul 06 19:26:11.774282 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.773789 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:11.775318 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.775286 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" event={"ID":"0c545a82-3b51-46e0-9383-99294291dcf7","Type":"ContainerStarted","Data":"2d313ecdf5400c3c5cfcc6e1ad9f11c48b4e70f7252f7cc91d3ade8f80c13ec8"} Jul 06 19:26:11.777555 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.777479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjsmr" event={"ID":"1feabb15-7b20-4f91-994e-f8060d8f9544","Type":"ContainerStarted","Data":"647f09fdf5011ea36dbbb66a3eb1b6182720a0fb714344e5ef65dbfa908c5ca2"} Jul 06 19:26:11.777555 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.777540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjsmr" event={"ID":"1feabb15-7b20-4f91-994e-f8060d8f9544","Type":"ContainerStarted","Data":"52f42378f6dc6150f2f8159622e398094260c0d70fdce36cd5fc6c8ce2a9510f"} Jul 06 19:26:11.778719 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.778681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-bw8z8" event={"ID":"aaa7b8f6-e959-4ca7-a50f-aa44a07bd147","Type":"ContainerStarted","Data":"c1aada5216276de16b761ae4896f934190bf91dc43c54bc48a2ec1342e1691cd"} Jul 06 19:26:11.801672 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:11.801604 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f66654587-5vwn2" podStartSLOduration=3.801583117 podStartE2EDuration="3.801583117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.800897543 +0000 UTC m=+175.367427483" watchObservedRunningTime="2026-07-06 19:26:11.801583117 +0000 UTC m=+175.368112972" Jul 06 19:26:12.786359 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:12.786251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" event={"ID":"0c545a82-3b51-46e0-9383-99294291dcf7","Type":"ContainerStarted","Data":"c396f526884f62f37a5452f7990360dbeae5c686f08c13ca7fe99286fa3fdbc6"} Jul 06 19:26:12.808139 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:12.808005 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" podStartSLOduration=3.294195232 podStartE2EDuration="4.807980475s" totalImagesPullingTime="1.513785243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:12.806819063 +0000 UTC m=+176.373348917" watchObservedRunningTime="2026-07-06 19:26:12.807980475 +0000 UTC m=+176.374510327" Jul 06 19:26:13.742721 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:13.742686 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pngvz" Jul 06 19:26:13.791144 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:13.791070 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:13.797717 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:13.797588 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zwsnd" Jul 06 19:26:14.797324 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:14.797279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jjsmr" event={"ID":"1feabb15-7b20-4f91-994e-f8060d8f9544","Type":"ContainerStarted","Data":"9f3513b2fcd0a98600c27de4ad04c4e49947feecb81591f265244dbb797aa61d"} Jul 06 19:26:20.223987 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.223923 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jjsmr" podStartSLOduration=39.205573453 podStartE2EDuration="46.223904249s" totalImagesPullingTime="7.018330796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:14.825276438 +0000 UTC m=+178.391806309" watchObservedRunningTime="2026-07-06 19:26:20.223904249 +0000 UTC m=+183.790434102" Jul 06 19:26:20.224624 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.224606 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm"] Jul 06 19:26:20.229413 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.229390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.232407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.232379 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:26:20.232651 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.232634 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:26:20.233977 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.233950 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:26:20.234086 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.234007 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 19:26:20.234086 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.234043 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8rdn8\"" Jul 06 19:26:20.234238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.234083 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:26:20.261603 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.261565 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm"] Jul 06 19:26:20.264110 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.264015 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-clg29"] Jul 06 19:26:20.267946 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.267923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.271287 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.271231 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:26:20.271469 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.271288 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:26:20.271649 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.271626 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sgsxh\"" Jul 06 19:26:20.271649 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.271641 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:26:20.343486 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343446 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbzk8\" (UniqueName: \"kubernetes.io/projected/0d0db986-5660-4e2d-8132-29df1205f611-kube-api-access-vbzk8\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.343486 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343489 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-root\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-textfile\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343545 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.343735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343602 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0db986-5660-4e2d-8132-29df1205f611-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.343735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-wtmp\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-accelerators-collector-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343956 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343956 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.343956 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-sys\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.343956 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfc8d\" (UniqueName: \"kubernetes.io/projected/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-kube-api-access-lfc8d\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.344141 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.343967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.344141 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.344036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-metrics-client-ca\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.444938 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.444899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-metrics-client-ca\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.444948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbzk8\" (UniqueName: \"kubernetes.io/projected/0d0db986-5660-4e2d-8132-29df1205f611-kube-api-access-vbzk8\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.444980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-root\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-root\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-textfile\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0db986-5660-4e2d-8132-29df1205f611-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.445165 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-wtmp\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-accelerators-collector-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:26:20.445232 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-sys\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:26:20.445308 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls podName:0d0db986-5660-4e2d-8132-29df1205f611 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:20.945287279 +0000 UTC m=+184.511817115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-pp6wm" (UID: "0d0db986-5660-4e2d-8132-29df1205f611") : secret "openshift-state-metrics-tls" not found Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-sys\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfc8d\" (UniqueName: \"kubernetes.io/projected/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-kube-api-access-lfc8d\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445636 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445636 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-textfile\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445636 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:26:20.445548 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:26:20.445636 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:26:20.445599 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls podName:d27e264b-79dc-4c24-95c8-f6dc2fc1ac67 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:20.945580032 +0000 UTC m=+184.512109880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls") pod "node-exporter-clg29" (UID: "d27e264b-79dc-4c24-95c8-f6dc2fc1ac67") : secret "node-exporter-tls" not found Jul 06 19:26:20.445636 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-metrics-client-ca\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445787 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-wtmp\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445896 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445874 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-accelerators-collector-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.445985 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.445960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d0db986-5660-4e2d-8132-29df1205f611-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.448244 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.448218 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.448460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.448439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.456255 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.456196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfc8d\" (UniqueName: \"kubernetes.io/projected/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-kube-api-access-lfc8d\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.456382 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.456302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbzk8\" (UniqueName: \"kubernetes.io/projected/0d0db986-5660-4e2d-8132-29df1205f611-kube-api-access-vbzk8\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.951217 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.951176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:20.951399 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.951292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.953994 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.953966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d27e264b-79dc-4c24-95c8-f6dc2fc1ac67-node-exporter-tls\") pod \"node-exporter-clg29\" (UID: \"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67\") " pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:20.954136 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:20.954002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d0db986-5660-4e2d-8132-29df1205f611-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-pp6wm\" (UID: \"0d0db986-5660-4e2d-8132-29df1205f611\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:21.139389 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:21.139351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" Jul 06 19:26:21.179769 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:21.179731 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-clg29" Jul 06 19:26:25.143903 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.143867 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dc754d9f9-whn5p"] Jul 06 19:26:25.147348 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.147323 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.151924 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.151885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:26:25.152084 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.151944 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f9qkq19chedac\"" Jul 06 19:26:25.152183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.151886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7nspq\"" Jul 06 19:26:25.152183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.151885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:26:25.152183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.152129 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:26:25.152325 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.152183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:26:25.159036 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.158969 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dc754d9f9-whn5p"] Jul 06 19:26:25.290507 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-client-certs\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290507 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-client-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4g7z\" (UniqueName: \"kubernetes.io/projected/39286453-88b3-47b4-a0da-c9ffb261cd3b-kube-api-access-c4g7z\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39286453-88b3-47b4-a0da-c9ffb261cd3b-audit-log\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-metrics-server-audit-profiles\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.290807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.290805 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-tls\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392366 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39286453-88b3-47b4-a0da-c9ffb261cd3b-audit-log\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-metrics-server-audit-profiles\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-tls\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-client-certs\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-client-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392827 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4g7z\" (UniqueName: \"kubernetes.io/projected/39286453-88b3-47b4-a0da-c9ffb261cd3b-kube-api-access-c4g7z\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.392827 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.392744 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39286453-88b3-47b4-a0da-c9ffb261cd3b-audit-log\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.393355 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.393291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.393564 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.393511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39286453-88b3-47b4-a0da-c9ffb261cd3b-metrics-server-audit-profiles\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.396004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.395896 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-client-certs\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.396004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.395913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-secret-metrics-server-tls\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.396612 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.396589 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39286453-88b3-47b4-a0da-c9ffb261cd3b-client-ca-bundle\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.406210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.406169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4g7z\" (UniqueName: \"kubernetes.io/projected/39286453-88b3-47b4-a0da-c9ffb261cd3b-kube-api-access-c4g7z\") pod \"metrics-server-5dc754d9f9-whn5p\" (UID: \"39286453-88b3-47b4-a0da-c9ffb261cd3b\") " pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:25.459005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:25.458966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:27.037660 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:27.037630 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27e264b_79dc_4c24_95c8_f6dc2fc1ac67.slice/crio-8f58707b82a0b8d2481a5721ddd144bb66cfcb24a1e3295fc379860b572decd1 WatchSource:0}: Error finding container 8f58707b82a0b8d2481a5721ddd144bb66cfcb24a1e3295fc379860b572decd1: Status 404 returned error can't find the container with id 8f58707b82a0b8d2481a5721ddd144bb66cfcb24a1e3295fc379860b572decd1 Jul 06 19:26:27.185864 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.185840 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm"] Jul 06 19:26:27.187686 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:27.187654 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0db986_5660_4e2d_8132_29df1205f611.slice/crio-4f54d408269cebd2fa38e0d1e158119542eab405b1458650b91188fcd1011d71 WatchSource:0}: Error finding container 4f54d408269cebd2fa38e0d1e158119542eab405b1458650b91188fcd1011d71: Status 404 returned error can't find the container with id 4f54d408269cebd2fa38e0d1e158119542eab405b1458650b91188fcd1011d71 Jul 06 19:26:27.198158 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.198131 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dc754d9f9-whn5p"] Jul 06 19:26:27.201736 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:26:27.201709 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39286453_88b3_47b4_a0da_c9ffb261cd3b.slice/crio-9df470f20d632ca51a9a01bf56abef9542f3fbb6e6a554d88a49930b097e7ba3 WatchSource:0}: Error finding container 9df470f20d632ca51a9a01bf56abef9542f3fbb6e6a554d88a49930b097e7ba3: Status 404 returned error can't find the container with id 9df470f20d632ca51a9a01bf56abef9542f3fbb6e6a554d88a49930b097e7ba3 Jul 06 19:26:27.856309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.855279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" event={"ID":"0d0db986-5660-4e2d-8132-29df1205f611","Type":"ContainerStarted","Data":"639d6169e11b4414a52baccf6c248f9bf457b1f661a1af9a7ad184648975cb1a"} Jul 06 19:26:27.856309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.855355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" event={"ID":"0d0db986-5660-4e2d-8132-29df1205f611","Type":"ContainerStarted","Data":"8b90377b7d3983ac6edc8d6f5b58ec24f725fb592f718fa26ad1dc1cd0f4d47a"} Jul 06 19:26:27.856309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.855387 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" event={"ID":"0d0db986-5660-4e2d-8132-29df1205f611","Type":"ContainerStarted","Data":"4f54d408269cebd2fa38e0d1e158119542eab405b1458650b91188fcd1011d71"} Jul 06 19:26:27.858838 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.858802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clg29" event={"ID":"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67","Type":"ContainerStarted","Data":"8f58707b82a0b8d2481a5721ddd144bb66cfcb24a1e3295fc379860b572decd1"} Jul 06 19:26:27.861398 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.861363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-bw8z8" event={"ID":"aaa7b8f6-e959-4ca7-a50f-aa44a07bd147","Type":"ContainerStarted","Data":"acdc93aac048db1c083ca53e86d9bc5ae45e8400d0f0be62d7c083723839a213"} Jul 06 19:26:27.862570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.862521 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:27.865729 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.865634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" event={"ID":"39286453-88b3-47b4-a0da-c9ffb261cd3b","Type":"ContainerStarted","Data":"9df470f20d632ca51a9a01bf56abef9542f3fbb6e6a554d88a49930b097e7ba3"} Jul 06 19:26:27.876391 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.876350 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-bw8z8" Jul 06 19:26:27.897074 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:27.896998 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-bw8z8" podStartSLOduration=3.696059187 podStartE2EDuration="19.896971687s" totalImagesPullingTime="16.2009125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:27.895289385 +0000 UTC m=+191.461819275" watchObservedRunningTime="2026-07-06 19:26:27.896971687 +0000 UTC m=+191.463501541" Jul 06 19:26:28.765988 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:28.765946 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:30.881041 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.881000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" event={"ID":"39286453-88b3-47b4-a0da-c9ffb261cd3b","Type":"ContainerStarted","Data":"ef7489f82ea8481b0d642ea7d4001e82ceb08737b70b3dd406ef989504892595"} Jul 06 19:26:30.883823 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.883788 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" event={"ID":"0d0db986-5660-4e2d-8132-29df1205f611","Type":"ContainerStarted","Data":"04d6d621a7fd9143e6148765c8bce504e300b82502e1a3143c6b3a8069c2fa2b"} Jul 06 19:26:30.885622 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.885597 2558 generic.go:356] "Generic (PLEG): container finished" podID="d27e264b-79dc-4c24-95c8-f6dc2fc1ac67" containerID="54f45d568f327444150cd00d4e5f82e40cc3f996d421387448c2f4568871dc20" exitCode=0 Jul 06 19:26:30.885760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.885644 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clg29" event={"ID":"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67","Type":"ContainerDied","Data":"54f45d568f327444150cd00d4e5f82e40cc3f996d421387448c2f4568871dc20"} Jul 06 19:26:30.920622 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.920554 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" podStartSLOduration=3.2369927609999998 podStartE2EDuration="5.920532793s" totalImagesPullingTime="2.683540032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:30.919596368 +0000 UTC m=+194.486126223" watchObservedRunningTime="2026-07-06 19:26:30.920532793 +0000 UTC m=+194.487062647" Jul 06 19:26:30.948789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:30.948728 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-pp6wm" podStartSLOduration=8.3933144 podStartE2EDuration="10.948710529s" totalImagesPullingTime="2.555396129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:30.947984752 +0000 UTC m=+194.514514655" watchObservedRunningTime="2026-07-06 19:26:30.948710529 +0000 UTC m=+194.515240381" Jul 06 19:26:31.893965 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:31.893906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clg29" event={"ID":"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67","Type":"ContainerStarted","Data":"72d1bc0e56dc5b04add5f23972f162d3ef51791e10ca1b1223e4a498b1a9161a"} Jul 06 19:26:31.894458 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:31.894024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-clg29" event={"ID":"d27e264b-79dc-4c24-95c8-f6dc2fc1ac67","Type":"ContainerStarted","Data":"fc12c888899637f3dc3200c5d1739350544ea4a9fcd9eee9454a520f026be0ae"} Jul 06 19:26:31.939412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:31.939347 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-clg29" podStartSLOduration=9.005535094 podStartE2EDuration="11.939324305s" totalImagesPullingTime="2.844374504s" totalInitContainerRuntime="89.414707ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:31.936793884 +0000 UTC m=+195.503323791" watchObservedRunningTime="2026-07-06 19:26:31.939324305 +0000 UTC m=+195.505854160" Jul 06 19:26:32.791487 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:32.791456 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f66654587-5vwn2" Jul 06 19:26:33.782718 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:33.782647 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" podUID="d6986465-3698-4e22-932e-6df550f2b971" containerName="registry" containerID="cri-o://55a4944e02ddb1bd14a5eadfafefa15b2e9069b98f03c7a0ebbaf573572cef51" gracePeriod=30 Jul 06 19:26:33.906367 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:33.906336 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6986465-3698-4e22-932e-6df550f2b971" containerID="55a4944e02ddb1bd14a5eadfafefa15b2e9069b98f03c7a0ebbaf573572cef51" exitCode=0 Jul 06 19:26:33.906523 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:33.906419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" event={"ID":"d6986465-3698-4e22-932e-6df550f2b971","Type":"ContainerDied","Data":"55a4944e02ddb1bd14a5eadfafefa15b2e9069b98f03c7a0ebbaf573572cef51"} Jul 06 19:26:34.581439 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.581399 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:34.683338 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683302 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.683517 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683375 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjmsb\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.683517 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683415 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.683517 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683447 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.684048 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683745 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.684048 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683818 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.684048 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683858 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.684048 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683868 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:26:34.684048 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.683898 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") pod \"d6986465-3698-4e22-932e-6df550f2b971\" (UID: \"d6986465-3698-4e22-932e-6df550f2b971\") " Jul 06 19:26:34.684395 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.684071 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:26:34.684395 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.684192 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-registry-certificates\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.684395 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.684210 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6986465-3698-4e22-932e-6df550f2b971-trusted-ca\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.686277 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.686245 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:26:34.686638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.686607 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:26:34.687011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.686986 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb" (OuterVolumeSpecName: "kube-api-access-kjmsb") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "kube-api-access-kjmsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:26:34.687523 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.687488 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:26:34.688562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.688530 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:26:34.695197 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.695165 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6986465-3698-4e22-932e-6df550f2b971" (UID: "d6986465-3698-4e22-932e-6df550f2b971"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785444 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-image-registry-private-configuration\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785474 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-bound-sa-token\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785486 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6986465-3698-4e22-932e-6df550f2b971-ca-trust-extracted\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785495 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-registry-tls\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785510 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6986465-3698-4e22-932e-6df550f2b971-installation-pull-secrets\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.785526 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.785525 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjmsb\" (UniqueName: \"kubernetes.io/projected/d6986465-3698-4e22-932e-6df550f2b971-kube-api-access-kjmsb\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:26:34.913028 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.912997 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" Jul 06 19:26:34.913028 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.913009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d456b57f6-txrzh" event={"ID":"d6986465-3698-4e22-932e-6df550f2b971","Type":"ContainerDied","Data":"9854fbc13320d11ef0a56e4be7f2e027f60963c42671542d7d828872ed03dcd5"} Jul 06 19:26:34.913304 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.913078 2558 scope.go:117] "RemoveContainer" containerID="55a4944e02ddb1bd14a5eadfafefa15b2e9069b98f03c7a0ebbaf573572cef51" Jul 06 19:26:34.914901 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.914863 2558 generic.go:356] "Generic (PLEG): container finished" podID="648cbf48-438f-4721-9adf-3526105fc007" containerID="e306464762a03c529d3f379521760d8b9cff0541c2c47291881230006310289f" exitCode=0 Jul 06 19:26:34.915005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.914911 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" event={"ID":"648cbf48-438f-4721-9adf-3526105fc007","Type":"ContainerDied","Data":"e306464762a03c529d3f379521760d8b9cff0541c2c47291881230006310289f"} Jul 06 19:26:34.915313 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.915290 2558 scope.go:117] "RemoveContainer" containerID="e306464762a03c529d3f379521760d8b9cff0541c2c47291881230006310289f" Jul 06 19:26:34.999034 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:34.998996 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:26:35.001377 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:35.001300 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d456b57f6-txrzh"] Jul 06 19:26:35.922160 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:35.922119 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vscg7" event={"ID":"648cbf48-438f-4721-9adf-3526105fc007","Type":"ContainerStarted","Data":"3a4429db2b3adec379b61273eed6bf5752c0283e7757d41a237631a8b0a54dde"} Jul 06 19:26:36.964563 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:36.964532 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6986465-3698-4e22-932e-6df550f2b971" path="/var/lib/kubelet/pods/d6986465-3698-4e22-932e-6df550f2b971/volumes" Jul 06 19:26:45.459709 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:45.459666 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:26:45.460224 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:26:45.459751 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:27:05.029650 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:05.029615 2558 generic.go:356] "Generic (PLEG): container finished" podID="fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56" containerID="f985ebc3efa5505fc5495bb40b04695dfbb9027f9dbed616ed6238aa6074350e" exitCode=0 Jul 06 19:27:05.030044 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:05.029680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" event={"ID":"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56","Type":"ContainerDied","Data":"f985ebc3efa5505fc5495bb40b04695dfbb9027f9dbed616ed6238aa6074350e"} Jul 06 19:27:05.030044 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:05.029967 2558 scope.go:117] "RemoveContainer" containerID="f985ebc3efa5505fc5495bb40b04695dfbb9027f9dbed616ed6238aa6074350e" Jul 06 19:27:05.465173 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:05.465143 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:27:05.469285 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:05.469256 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dc754d9f9-whn5p" Jul 06 19:27:06.035011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:06.034977 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-mgb4n" event={"ID":"fc6cbbf0-ff55-4ca7-a28d-5393fe1f7f56","Type":"ContainerStarted","Data":"8376e96bc4513ac81614f4a0fdc8331a64c9237a6e8a3bd26f1a7f40573aac09"} Jul 06 19:27:28.737503 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:28.737437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:27:28.739767 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:28.739741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de68b83-bea1-4e9d-aceb-c738ae92ec30-metrics-certs\") pod \"network-metrics-daemon-748sj\" (UID: \"5de68b83-bea1-4e9d-aceb-c738ae92ec30\") " pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:27:28.763331 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:28.763295 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mm8d\"" Jul 06 19:27:28.770624 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:28.770602 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-748sj" Jul 06 19:27:28.909818 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:28.909780 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-748sj"] Jul 06 19:27:28.913823 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:27:28.913785 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de68b83_bea1_4e9d_aceb_c738ae92ec30.slice/crio-48f9d41b1baa66b807516680fb57408f8445f93d60bd89e1f60888bfc7bd117c WatchSource:0}: Error finding container 48f9d41b1baa66b807516680fb57408f8445f93d60bd89e1f60888bfc7bd117c: Status 404 returned error can't find the container with id 48f9d41b1baa66b807516680fb57408f8445f93d60bd89e1f60888bfc7bd117c Jul 06 19:27:29.115629 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:29.115544 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-748sj" event={"ID":"5de68b83-bea1-4e9d-aceb-c738ae92ec30","Type":"ContainerStarted","Data":"48f9d41b1baa66b807516680fb57408f8445f93d60bd89e1f60888bfc7bd117c"} Jul 06 19:27:30.120799 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:30.120759 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-748sj" event={"ID":"5de68b83-bea1-4e9d-aceb-c738ae92ec30","Type":"ContainerStarted","Data":"4cf575ec60721e35e98cfda3afdae0f2dfc8a7a4e5332e8d85e1d6c0538e384b"} Jul 06 19:27:30.121311 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:30.120817 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-748sj" event={"ID":"5de68b83-bea1-4e9d-aceb-c738ae92ec30","Type":"ContainerStarted","Data":"7406aa26708703ad27da741f61ba363f4779cdd7b8284f6e74cd57a7457f05df"} Jul 06 19:27:30.141649 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:30.141544 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-748sj" podStartSLOduration=252.183316425 podStartE2EDuration="4m13.141527791s" totalImagesPullingTime="958.211366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:30.140883628 +0000 UTC m=+253.707413480" watchObservedRunningTime="2026-07-06 19:27:30.141527791 +0000 UTC m=+253.708057645" Jul 06 19:27:45.101780 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.101683 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb"] Jul 06 19:27:45.102222 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.102039 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6986465-3698-4e22-932e-6df550f2b971" containerName="registry" Jul 06 19:27:45.102222 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.102052 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6986465-3698-4e22-932e-6df550f2b971" containerName="registry" Jul 06 19:27:45.102222 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.102126 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6986465-3698-4e22-932e-6df550f2b971" containerName="registry" Jul 06 19:27:45.104060 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.104045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.106876 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.106848 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:27:45.107011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.106848 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:27:45.107011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.106849 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:27:45.107011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.106884 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:27:45.107266 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.107252 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:27:45.107344 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.107315 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ndmdg\"" Jul 06 19:27:45.112920 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.112901 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:27:45.117519 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.117493 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb"] Jul 06 19:27:45.164739 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.164739 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165026 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-metrics-client-ca\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165026 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165026 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165026 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.164924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-federate-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165239 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.165043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vjp\" (UniqueName: \"kubernetes.io/projected/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-kube-api-access-h5vjp\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.165239 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.165088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-serving-certs-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266335 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vjp\" (UniqueName: \"kubernetes.io/projected/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-kube-api-access-h5vjp\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266335 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266337 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-serving-certs-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266462 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-metrics-client-ca\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.266602 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.266554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-federate-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.267253 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.267225 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-serving-certs-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.267430 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.267301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-metrics-client-ca\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.267430 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.267415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.269121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.269085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-telemeter-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.269303 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.269279 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.269375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.269358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.269432 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.269407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-federate-client-tls\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.278942 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.278910 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vjp\" (UniqueName: \"kubernetes.io/projected/d4a444ce-d8aa-48f8-99e4-e3fc4c238110-kube-api-access-h5vjp\") pod \"telemeter-client-8fc6d7d4-5bxwb\" (UID: \"d4a444ce-d8aa-48f8-99e4-e3fc4c238110\") " pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.414346 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.414304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" Jul 06 19:27:45.558127 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:45.558020 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb"] Jul 06 19:27:45.565706 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:27:45.565667 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a444ce_d8aa_48f8_99e4_e3fc4c238110.slice/crio-e5015016ddba13a1cf29305f13df55b2afa4cc1486697d85b13a6d816d951dee WatchSource:0}: Error finding container e5015016ddba13a1cf29305f13df55b2afa4cc1486697d85b13a6d816d951dee: Status 404 returned error can't find the container with id e5015016ddba13a1cf29305f13df55b2afa4cc1486697d85b13a6d816d951dee Jul 06 19:27:46.183838 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:46.183795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" event={"ID":"d4a444ce-d8aa-48f8-99e4-e3fc4c238110","Type":"ContainerStarted","Data":"e5015016ddba13a1cf29305f13df55b2afa4cc1486697d85b13a6d816d951dee"} Jul 06 19:27:48.193211 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:48.193175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" event={"ID":"d4a444ce-d8aa-48f8-99e4-e3fc4c238110","Type":"ContainerStarted","Data":"c3c142c5b2968dc8ebd2b9eeadbad6280ee4043cd01423ef089f678a0939dc59"} Jul 06 19:27:50.202067 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:50.202027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" event={"ID":"d4a444ce-d8aa-48f8-99e4-e3fc4c238110","Type":"ContainerStarted","Data":"bba8052ca728266fe943d5a19bea60f7c58d79fba55b079cab1619d82424696b"} Jul 06 19:27:50.202498 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:50.202118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" event={"ID":"d4a444ce-d8aa-48f8-99e4-e3fc4c238110","Type":"ContainerStarted","Data":"46612487c786b463309581426d9523066fa4cfa9e77abb4f74971d83267fb9a6"} Jul 06 19:27:50.231110 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:27:50.231040 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8fc6d7d4-5bxwb" podStartSLOduration=1.665010822 podStartE2EDuration="5.231022547s" totalImagesPullingTime="3.566011725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:50.229960503 +0000 UTC m=+273.796490357" watchObservedRunningTime="2026-07-06 19:27:50.231022547 +0000 UTC m=+273.797552401" Jul 06 19:28:16.858302 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:16.858275 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:28:16.860560 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:16.860536 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:28:16.869696 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:16.869677 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:28:38.271535 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.271493 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d"] Jul 06 19:28:38.276685 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.276670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.279809 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.279787 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:28:38.281183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.281166 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:28:38.281271 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.281171 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9hvsl\"" Jul 06 19:28:38.285889 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.285863 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d"] Jul 06 19:28:38.388372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.388341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tklvq\" (UniqueName: \"kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.388372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.388384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.388601 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.388461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.489722 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.489681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.489892 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.489762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tklvq\" (UniqueName: \"kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.489892 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.489801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.490186 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.490167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.490186 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.490179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.499268 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.499233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tklvq\" (UniqueName: \"kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.586324 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.586227 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:28:38.726597 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.726561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d"] Jul 06 19:28:38.729689 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:28:38.729660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d96dab8_bd8b_49ef_ab34_78a502cc46d1.slice/crio-3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313 WatchSource:0}: Error finding container 3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313: Status 404 returned error can't find the container with id 3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313 Jul 06 19:28:38.731695 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:38.731677 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:28:39.380362 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:39.380332 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" event={"ID":"6d96dab8-bd8b-49ef-ab34-78a502cc46d1","Type":"ContainerStarted","Data":"3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313"} Jul 06 19:28:47.416773 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:47.416738 2558 generic.go:356] "Generic (PLEG): container finished" podID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerID="66f776285d768f7746bba71cad3d5a73d8eb503840813d75cbebc5b934212050" exitCode=0 Jul 06 19:28:47.417183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:47.416827 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" event={"ID":"6d96dab8-bd8b-49ef-ab34-78a502cc46d1","Type":"ContainerDied","Data":"66f776285d768f7746bba71cad3d5a73d8eb503840813d75cbebc5b934212050"} Jul 06 19:28:50.430446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:50.430409 2558 generic.go:356] "Generic (PLEG): container finished" podID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerID="dda1f4a7514bc50f7ee7e6027028659b8c8c30275fe4af4becb40867b2aaa937" exitCode=0 Jul 06 19:28:50.430832 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:50.430492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" event={"ID":"6d96dab8-bd8b-49ef-ab34-78a502cc46d1","Type":"ContainerDied","Data":"dda1f4a7514bc50f7ee7e6027028659b8c8c30275fe4af4becb40867b2aaa937"} Jul 06 19:28:59.469789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:59.469755 2558 generic.go:356] "Generic (PLEG): container finished" podID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerID="8befa751d84f28de972508ac01f1aace22a7f07dd23b07419822f818a212575e" exitCode=0 Jul 06 19:28:59.470256 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:28:59.469835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" event={"ID":"6d96dab8-bd8b-49ef-ab34-78a502cc46d1","Type":"ContainerDied","Data":"8befa751d84f28de972508ac01f1aace22a7f07dd23b07419822f818a212575e"} Jul 06 19:29:00.625517 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.625481 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:29:00.778982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.778883 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle\") pod \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " Jul 06 19:29:00.778982 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.778951 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util\") pod \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " Jul 06 19:29:00.779255 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.778991 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tklvq\" (UniqueName: \"kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq\") pod \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\" (UID: \"6d96dab8-bd8b-49ef-ab34-78a502cc46d1\") " Jul 06 19:29:00.779673 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.779633 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle" (OuterVolumeSpecName: "bundle") pod "6d96dab8-bd8b-49ef-ab34-78a502cc46d1" (UID: "6d96dab8-bd8b-49ef-ab34-78a502cc46d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:00.781291 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.781262 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq" (OuterVolumeSpecName: "kube-api-access-tklvq") pod "6d96dab8-bd8b-49ef-ab34-78a502cc46d1" (UID: "6d96dab8-bd8b-49ef-ab34-78a502cc46d1"). InnerVolumeSpecName "kube-api-access-tklvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:00.783042 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.783021 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util" (OuterVolumeSpecName: "util") pod "6d96dab8-bd8b-49ef-ab34-78a502cc46d1" (UID: "6d96dab8-bd8b-49ef-ab34-78a502cc46d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:00.879815 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.879776 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tklvq\" (UniqueName: \"kubernetes.io/projected/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-kube-api-access-tklvq\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:00.879815 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.879809 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:00.880008 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:00.879832 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d96dab8-bd8b-49ef-ab34-78a502cc46d1-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:01.478767 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:01.478730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" event={"ID":"6d96dab8-bd8b-49ef-ab34-78a502cc46d1","Type":"ContainerDied","Data":"3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313"} Jul 06 19:29:01.478936 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:01.478786 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c43f537c86081abf85b403bc3a9ea15ba8ae5e3aed5faf1d1efe54fe86a7313" Jul 06 19:29:01.478936 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:01.478751 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402828d" Jul 06 19:29:06.268502 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.268461 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv"] Jul 06 19:29:06.269150 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269125 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="pull" Jul 06 19:29:06.269150 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269148 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="pull" Jul 06 19:29:06.269308 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269178 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="util" Jul 06 19:29:06.269308 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269187 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="util" Jul 06 19:29:06.269308 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269207 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="extract" Jul 06 19:29:06.269308 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269215 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="extract" Jul 06 19:29:06.269472 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.269350 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d96dab8-bd8b-49ef-ab34-78a502cc46d1" containerName="extract" Jul 06 19:29:06.272806 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.272784 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.275640 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.275614 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:29:06.275758 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.275684 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hmnjq\"" Jul 06 19:29:06.275758 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.275742 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 19:29:06.288731 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.288703 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv"] Jul 06 19:29:06.421077 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.421043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf95x\" (UniqueName: \"kubernetes.io/projected/4fb40ccf-d846-4c4f-acac-350c314038b5-kube-api-access-tf95x\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.421291 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.421139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb40ccf-d846-4c4f-acac-350c314038b5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.521958 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.521853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb40ccf-d846-4c4f-acac-350c314038b5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.521958 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.521919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf95x\" (UniqueName: \"kubernetes.io/projected/4fb40ccf-d846-4c4f-acac-350c314038b5-kube-api-access-tf95x\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.522407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.522386 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb40ccf-d846-4c4f-acac-350c314038b5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.533613 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.533581 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf95x\" (UniqueName: \"kubernetes.io/projected/4fb40ccf-d846-4c4f-acac-350c314038b5-kube-api-access-tf95x\") pod \"cert-manager-operator-controller-manager-55c444bf86-9m4hv\" (UID: \"4fb40ccf-d846-4c4f-acac-350c314038b5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.581638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.581601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" Jul 06 19:29:06.725293 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:06.725258 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv"] Jul 06 19:29:06.729545 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:06.729513 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb40ccf_d846_4c4f_acac_350c314038b5.slice/crio-78b8ea84cc5c7cb4129814a8a538fd002d21a4df93f3b5e9e7fda037e39f3eeb WatchSource:0}: Error finding container 78b8ea84cc5c7cb4129814a8a538fd002d21a4df93f3b5e9e7fda037e39f3eeb: Status 404 returned error can't find the container with id 78b8ea84cc5c7cb4129814a8a538fd002d21a4df93f3b5e9e7fda037e39f3eeb Jul 06 19:29:07.505028 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:07.504994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" event={"ID":"4fb40ccf-d846-4c4f-acac-350c314038b5","Type":"ContainerStarted","Data":"78b8ea84cc5c7cb4129814a8a538fd002d21a4df93f3b5e9e7fda037e39f3eeb"} Jul 06 19:29:08.511167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:08.511130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" event={"ID":"4fb40ccf-d846-4c4f-acac-350c314038b5","Type":"ContainerStarted","Data":"a386eb0cc2f80e0c892356ce20c3156c9d806ac1a21433e5ca3e3f3d029d503a"} Jul 06 19:29:08.539318 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:08.539259 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9m4hv" podStartSLOduration=0.927604666 podStartE2EDuration="2.539240729s" totalImagesPullingTime="1.611636063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:08.5368222 +0000 UTC m=+352.103352052" watchObservedRunningTime="2026-07-06 19:29:08.539240729 +0000 UTC m=+352.105770690" Jul 06 19:29:09.818248 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.818155 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf"] Jul 06 19:29:09.821293 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.821276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:09.824386 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.824365 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:29:09.825758 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.825741 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9hvsl\"" Jul 06 19:29:09.825835 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.825749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:29:09.831910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.831883 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf"] Jul 06 19:29:09.951368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.951325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:09.951368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.951372 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:09.951599 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:09.951393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7hv\" (UniqueName: \"kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.052793 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.052744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.052793 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.052789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.053054 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.052824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7hv\" (UniqueName: \"kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.053255 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.053236 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.053309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.053270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.089549 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.089469 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7hv\" (UniqueName: \"kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.130965 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.130918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:10.275239 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.275200 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf"] Jul 06 19:29:10.277910 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:10.277881 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7685b33_0373_4ed3_a9c2_dbd3dad5854a.slice/crio-4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6 WatchSource:0}: Error finding container 4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6: Status 404 returned error can't find the container with id 4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6 Jul 06 19:29:10.521942 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.521909 2558 generic.go:356] "Generic (PLEG): container finished" podID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerID="a42f59e31b7c2939525f897154457f64bc0507399fb49602cbf2cedd7cd5cf1c" exitCode=0 Jul 06 19:29:10.522121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.521971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" event={"ID":"d7685b33-0373-4ed3-a9c2-dbd3dad5854a","Type":"ContainerDied","Data":"a42f59e31b7c2939525f897154457f64bc0507399fb49602cbf2cedd7cd5cf1c"} Jul 06 19:29:10.522121 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.522014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" event={"ID":"d7685b33-0373-4ed3-a9c2-dbd3dad5854a","Type":"ContainerStarted","Data":"4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6"} Jul 06 19:29:10.876213 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.876175 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v77kj"] Jul 06 19:29:10.879632 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.879611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:10.882616 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.882590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vpjxq\"" Jul 06 19:29:10.882760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.882623 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:29:10.882760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.882682 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:29:10.894987 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.894958 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v77kj"] Jul 06 19:29:10.959967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.959928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxdl\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-kube-api-access-9xxdl\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:10.959967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:10.959979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.061075 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.061041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.061288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.061176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxdl\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-kube-api-access-9xxdl\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.075360 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.075324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.075496 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.075466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxdl\" (UniqueName: \"kubernetes.io/projected/3b398de5-adda-40f7-ae1b-8bb92c0837a8-kube-api-access-9xxdl\") pod \"cert-manager-webhook-6486ffd997-v77kj\" (UID: \"3b398de5-adda-40f7-ae1b-8bb92c0837a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.205708 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.205615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:11.366011 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.365967 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v77kj"] Jul 06 19:29:11.369818 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:11.369786 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b398de5_adda_40f7_ae1b_8bb92c0837a8.slice/crio-6ac961210d461a9e12a6d92de349b3495dde28f6ffa69c5554b4beb0d57cdbdd WatchSource:0}: Error finding container 6ac961210d461a9e12a6d92de349b3495dde28f6ffa69c5554b4beb0d57cdbdd: Status 404 returned error can't find the container with id 6ac961210d461a9e12a6d92de349b3495dde28f6ffa69c5554b4beb0d57cdbdd Jul 06 19:29:11.528379 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:11.528290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" event={"ID":"3b398de5-adda-40f7-ae1b-8bb92c0837a8","Type":"ContainerStarted","Data":"6ac961210d461a9e12a6d92de349b3495dde28f6ffa69c5554b4beb0d57cdbdd"} Jul 06 19:29:13.538051 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:13.538014 2558 generic.go:356] "Generic (PLEG): container finished" podID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerID="d58cdb95b3d2bbd6eb120d6da703693a65ae474ad2d7f5ecd5bf60887b67e986" exitCode=0 Jul 06 19:29:13.538516 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:13.538127 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" event={"ID":"d7685b33-0373-4ed3-a9c2-dbd3dad5854a","Type":"ContainerDied","Data":"d58cdb95b3d2bbd6eb120d6da703693a65ae474ad2d7f5ecd5bf60887b67e986"} Jul 06 19:29:14.545601 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:14.545559 2558 generic.go:356] "Generic (PLEG): container finished" podID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerID="596a6a87ee662bc1bcae2219d5c47e4184e02d814684862f22212028173bfa05" exitCode=0 Jul 06 19:29:14.546032 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:14.545618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" event={"ID":"d7685b33-0373-4ed3-a9c2-dbd3dad5854a","Type":"ContainerDied","Data":"596a6a87ee662bc1bcae2219d5c47e4184e02d814684862f22212028173bfa05"} Jul 06 19:29:15.552203 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.552092 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" event={"ID":"3b398de5-adda-40f7-ae1b-8bb92c0837a8","Type":"ContainerStarted","Data":"c7162a4968ec00aefe1d7b8c04664ecf25a6d382e097ce491c0297dd956ca546"} Jul 06 19:29:15.552203 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.552167 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:15.587653 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.587597 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" podStartSLOduration=1.7863809800000001 podStartE2EDuration="5.587581509s" totalImagesPullingTime="3.801200529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:15.584167669 +0000 UTC m=+359.150697524" watchObservedRunningTime="2026-07-06 19:29:15.587581509 +0000 UTC m=+359.154111362" Jul 06 19:29:15.685809 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.685783 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:15.805574 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.805485 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util\") pod \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " Jul 06 19:29:15.805574 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.805576 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle\") pod \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " Jul 06 19:29:15.805761 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.805604 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw7hv\" (UniqueName: \"kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv\") pod \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\" (UID: \"d7685b33-0373-4ed3-a9c2-dbd3dad5854a\") " Jul 06 19:29:15.805979 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.805945 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle" (OuterVolumeSpecName: "bundle") pod "d7685b33-0373-4ed3-a9c2-dbd3dad5854a" (UID: "d7685b33-0373-4ed3-a9c2-dbd3dad5854a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:15.807892 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.807868 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv" (OuterVolumeSpecName: "kube-api-access-cw7hv") pod "d7685b33-0373-4ed3-a9c2-dbd3dad5854a" (UID: "d7685b33-0373-4ed3-a9c2-dbd3dad5854a"). InnerVolumeSpecName "kube-api-access-cw7hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:15.862557 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.862483 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util" (OuterVolumeSpecName: "util") pod "d7685b33-0373-4ed3-a9c2-dbd3dad5854a" (UID: "d7685b33-0373-4ed3-a9c2-dbd3dad5854a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:15.906950 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.906919 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:15.906950 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.906952 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw7hv\" (UniqueName: \"kubernetes.io/projected/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-kube-api-access-cw7hv\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:15.907088 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:15.906965 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7685b33-0373-4ed3-a9c2-dbd3dad5854a-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:16.558288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:16.558252 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" Jul 06 19:29:16.558288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:16.558276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvnhf" event={"ID":"d7685b33-0373-4ed3-a9c2-dbd3dad5854a","Type":"ContainerDied","Data":"4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6"} Jul 06 19:29:16.558722 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:16.558320 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ae32073b5ee0be61728879125f66c37e45e4103e90d57f200340d39dacd66f6" Jul 06 19:29:20.173856 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.173820 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v"] Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174150 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="extract" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174163 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="extract" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174178 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="util" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174191 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="util" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174208 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="pull" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174214 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="pull" Jul 06 19:29:20.174299 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.174261 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7685b33-0373-4ed3-a9c2-dbd3dad5854a" containerName="extract" Jul 06 19:29:20.180324 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.180303 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.183250 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.183228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:29:20.183366 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.183268 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-82m7f\"" Jul 06 19:29:20.184783 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.184762 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:29:20.195587 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.195564 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v"] Jul 06 19:29:20.343456 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.343419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.343456 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.343462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqdqw\" (UniqueName: \"kubernetes.io/projected/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-kube-api-access-lqdqw\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.444783 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.444683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.444783 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.444747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqdqw\" (UniqueName: \"kubernetes.io/projected/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-kube-api-access-lqdqw\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.445056 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.445039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.453910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.453882 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqdqw\" (UniqueName: \"kubernetes.io/projected/d246dc80-9e3d-4bbc-9f68-90310a82b1f3-kube-api-access-lqdqw\") pod \"openshift-lws-operator-fd8ccff4c-rzf4v\" (UID: \"d246dc80-9e3d-4bbc-9f68-90310a82b1f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.489430 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.489394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" Jul 06 19:29:20.625505 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.625305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v"] Jul 06 19:29:20.628208 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:20.628167 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd246dc80_9e3d_4bbc_9f68_90310a82b1f3.slice/crio-1464db437e369bf917dba63dfb4e69e359391f327266b3eaf043b6a0ce7b3e62 WatchSource:0}: Error finding container 1464db437e369bf917dba63dfb4e69e359391f327266b3eaf043b6a0ce7b3e62: Status 404 returned error can't find the container with id 1464db437e369bf917dba63dfb4e69e359391f327266b3eaf043b6a0ce7b3e62 Jul 06 19:29:20.974376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.974342 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf5k6"] Jul 06 19:29:20.979486 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.979470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:20.982228 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.982207 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9dwp8\"" Jul 06 19:29:20.989192 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:20.989171 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf5k6"] Jul 06 19:29:21.150679 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.150639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.150679 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.150680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2f2t\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-kube-api-access-q2f2t\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.251694 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.251604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.251694 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.251653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2f2t\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-kube-api-access-q2f2t\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.261131 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.261057 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2f2t\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-kube-api-access-q2f2t\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.264185 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.264163 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f85f133-0f39-4d5f-bec4-e94df757c048-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf5k6\" (UID: \"6f85f133-0f39-4d5f-bec4-e94df757c048\") " pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.290346 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.290298 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zf5k6" Jul 06 19:29:21.449857 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.449826 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf5k6"] Jul 06 19:29:21.452873 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:21.452839 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f85f133_0f39_4d5f_bec4_e94df757c048.slice/crio-57971008fa5d9950bb5093fb1e6091d9918f0d75afbe9a57b313d112256acdf4 WatchSource:0}: Error finding container 57971008fa5d9950bb5093fb1e6091d9918f0d75afbe9a57b313d112256acdf4: Status 404 returned error can't find the container with id 57971008fa5d9950bb5093fb1e6091d9918f0d75afbe9a57b313d112256acdf4 Jul 06 19:29:21.561387 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.561357 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v77kj" Jul 06 19:29:21.583375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.583335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zf5k6" event={"ID":"6f85f133-0f39-4d5f-bec4-e94df757c048","Type":"ContainerStarted","Data":"b973e2b3ee7044a53f8351bfd3f74bae12504cb36517fd98903ed1f65a72ae3c"} Jul 06 19:29:21.583560 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.583387 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zf5k6" event={"ID":"6f85f133-0f39-4d5f-bec4-e94df757c048","Type":"ContainerStarted","Data":"57971008fa5d9950bb5093fb1e6091d9918f0d75afbe9a57b313d112256acdf4"} Jul 06 19:29:21.584859 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.584835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" event={"ID":"d246dc80-9e3d-4bbc-9f68-90310a82b1f3","Type":"ContainerStarted","Data":"1464db437e369bf917dba63dfb4e69e359391f327266b3eaf043b6a0ce7b3e62"} Jul 06 19:29:21.606758 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:21.606682 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zf5k6" podStartSLOduration=1.606663044 podStartE2EDuration="1.606663044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:21.606376243 +0000 UTC m=+365.172906098" watchObservedRunningTime="2026-07-06 19:29:21.606663044 +0000 UTC m=+365.173192897" Jul 06 19:29:22.590610 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:22.590566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" event={"ID":"d246dc80-9e3d-4bbc-9f68-90310a82b1f3","Type":"ContainerStarted","Data":"b1afaeac1c2c25376b83b99feebef026083ffad68bf530f00980d69c8e5cc3b6"} Jul 06 19:29:22.610532 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:22.610481 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rzf4v" podStartSLOduration=0.815982905 podStartE2EDuration="2.610465054s" totalImagesPullingTime="1.794482149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:22.609553907 +0000 UTC m=+366.176083756" watchObservedRunningTime="2026-07-06 19:29:22.610465054 +0000 UTC m=+366.176994907" Jul 06 19:29:25.187673 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.187639 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg"] Jul 06 19:29:25.232841 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.232804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg"] Jul 06 19:29:25.232985 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.232930 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.236028 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.236004 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:29:25.236199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.236032 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:29:25.236199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.236034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9hvsl\"" Jul 06 19:29:25.386184 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.386130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.386184 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.386192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.386406 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.386250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59kt6\" (UniqueName: \"kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.487167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.487047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.487167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.487089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.487167 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.487140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59kt6\" (UniqueName: \"kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.487451 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.487436 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.487535 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.487511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.496381 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.496350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59kt6\" (UniqueName: \"kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.542047 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.542001 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:25.687601 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:25.687567 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg"] Jul 06 19:29:25.691713 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:25.691686 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3a6304_9832_45d4_8b78_0d72d10a9966.slice/crio-35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f WatchSource:0}: Error finding container 35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f: Status 404 returned error can't find the container with id 35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f Jul 06 19:29:26.611947 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:26.611915 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerID="031964514ce75028ad39ec0a7a692dc64309fae7b1ff4a52f2f3adb408e57bc8" exitCode=0 Jul 06 19:29:26.612508 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:26.612004 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" event={"ID":"2a3a6304-9832-45d4-8b78-0d72d10a9966","Type":"ContainerDied","Data":"031964514ce75028ad39ec0a7a692dc64309fae7b1ff4a52f2f3adb408e57bc8"} Jul 06 19:29:26.612508 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:26.612055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" event={"ID":"2a3a6304-9832-45d4-8b78-0d72d10a9966","Type":"ContainerStarted","Data":"35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f"} Jul 06 19:29:27.864372 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:29:27.864336 2558 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3a6304_9832_45d4_8b78_0d72d10a9966.slice/crio-conmon-49bb5a13af59905c726e4880e05ccd7148a3e9db4e2c04f1296844eb34b262db.scope\": RecentStats: unable to find data in memory cache]" Jul 06 19:29:28.622539 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:28.622503 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerID="49bb5a13af59905c726e4880e05ccd7148a3e9db4e2c04f1296844eb34b262db" exitCode=0 Jul 06 19:29:28.622725 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:28.622556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" event={"ID":"2a3a6304-9832-45d4-8b78-0d72d10a9966","Type":"ContainerDied","Data":"49bb5a13af59905c726e4880e05ccd7148a3e9db4e2c04f1296844eb34b262db"} Jul 06 19:29:29.629763 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:29.629728 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerID="b06201db6de3727e432e5a1c5a7bac8968d82b37eca5778fdd3c85fcb9df6471" exitCode=0 Jul 06 19:29:29.630184 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:29.629796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" event={"ID":"2a3a6304-9832-45d4-8b78-0d72d10a9966","Type":"ContainerDied","Data":"b06201db6de3727e432e5a1c5a7bac8968d82b37eca5778fdd3c85fcb9df6471"} Jul 06 19:29:30.768132 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.768089 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:30.934845 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.934754 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util\") pod \"2a3a6304-9832-45d4-8b78-0d72d10a9966\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " Jul 06 19:29:30.934845 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.934799 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59kt6\" (UniqueName: \"kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6\") pod \"2a3a6304-9832-45d4-8b78-0d72d10a9966\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " Jul 06 19:29:30.934845 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.934837 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle\") pod \"2a3a6304-9832-45d4-8b78-0d72d10a9966\" (UID: \"2a3a6304-9832-45d4-8b78-0d72d10a9966\") " Jul 06 19:29:30.935613 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.935586 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle" (OuterVolumeSpecName: "bundle") pod "2a3a6304-9832-45d4-8b78-0d72d10a9966" (UID: "2a3a6304-9832-45d4-8b78-0d72d10a9966"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:30.936939 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.936911 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6" (OuterVolumeSpecName: "kube-api-access-59kt6") pod "2a3a6304-9832-45d4-8b78-0d72d10a9966" (UID: "2a3a6304-9832-45d4-8b78-0d72d10a9966"). InnerVolumeSpecName "kube-api-access-59kt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:30.940362 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:30.940341 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util" (OuterVolumeSpecName: "util") pod "2a3a6304-9832-45d4-8b78-0d72d10a9966" (UID: "2a3a6304-9832-45d4-8b78-0d72d10a9966"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:29:31.035911 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.035872 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:31.035911 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.035903 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a3a6304-9832-45d4-8b78-0d72d10a9966-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:31.035911 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.035911 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59kt6\" (UniqueName: \"kubernetes.io/projected/2a3a6304-9832-45d4-8b78-0d72d10a9966-kube-api-access-59kt6\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:29:31.640910 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.640877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" event={"ID":"2a3a6304-9832-45d4-8b78-0d72d10a9966","Type":"ContainerDied","Data":"35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f"} Jul 06 19:29:31.641082 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.640928 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35e2b0ed94e8f5b8c0a537f25debc9ad105c595d826fac023b82cf1536cda30f" Jul 06 19:29:31.641082 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:31.640888 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9rctg" Jul 06 19:29:43.668755 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.668713 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n"] Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669023 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="util" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669033 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="util" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669048 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="extract" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669053 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="extract" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669062 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="pull" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669067 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="pull" Jul 06 19:29:43.669280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.669144 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a3a6304-9832-45d4-8b78-0d72d10a9966" containerName="extract" Jul 06 19:29:43.671338 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.671313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.677522 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.677490 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:29:43.677681 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.677534 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:29:43.677750 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.677694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:29:43.677750 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.677694 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bkc2r\"" Jul 06 19:29:43.678230 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.677784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:29:43.693478 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.693450 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n"] Jul 06 19:29:43.724697 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.724651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-tmp\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.724697 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.724699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.724923 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.724717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.724923 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.724805 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-manifests\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.724923 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.724889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qjtm\" (UniqueName: \"kubernetes.io/projected/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-kube-api-access-5qjtm\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825383 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-manifests\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qjtm\" (UniqueName: \"kubernetes.io/projected/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-kube-api-access-5qjtm\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-tmp\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.825820 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.825794 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-manifests\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.827711 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.827683 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-tmp\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.827974 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.827952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.828061 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.828026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.835454 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.835424 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qjtm\" (UniqueName: \"kubernetes.io/projected/0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8-kube-api-access-5qjtm\") pod \"opendatahub-operator-controller-manager-7fcb8c7879-j6r4n\" (UID: \"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:43.981436 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:43.981341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:44.139340 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:44.139313 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n"] Jul 06 19:29:44.141915 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:29:44.141887 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4aaf91_cefa_4042_8f68_1c3ac69ed4c8.slice/crio-44d051539beadd522e3de8b1a3ea3b20f5895d1df4628637be1dddda4876ebf7 WatchSource:0}: Error finding container 44d051539beadd522e3de8b1a3ea3b20f5895d1df4628637be1dddda4876ebf7: Status 404 returned error can't find the container with id 44d051539beadd522e3de8b1a3ea3b20f5895d1df4628637be1dddda4876ebf7 Jul 06 19:29:44.702545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:44.702504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" event={"ID":"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8","Type":"ContainerStarted","Data":"44d051539beadd522e3de8b1a3ea3b20f5895d1df4628637be1dddda4876ebf7"} Jul 06 19:29:47.721071 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:47.721035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" event={"ID":"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8","Type":"ContainerStarted","Data":"523aac7ca6ffe6881b914cbdd8e46a482b78ae01edc0156c445ddca73ecd0097"} Jul 06 19:29:48.727940 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:48.727902 2558 generic.go:356] "Generic (PLEG): container finished" podID="0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8" containerID="523aac7ca6ffe6881b914cbdd8e46a482b78ae01edc0156c445ddca73ecd0097" exitCode=0 Jul 06 19:29:48.728482 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:48.727952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" event={"ID":"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8","Type":"ContainerDied","Data":"523aac7ca6ffe6881b914cbdd8e46a482b78ae01edc0156c445ddca73ecd0097"} Jul 06 19:29:49.734946 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:49.734909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" event={"ID":"0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8","Type":"ContainerStarted","Data":"e9dc325b6520972ab3774259509372e597e3153a8df170739d602dbe591d689f"} Jul 06 19:29:49.735379 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:49.735029 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:29:49.777481 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:29:49.777422 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" podStartSLOduration=2.3348435260000002 podStartE2EDuration="6.777404168s" totalImagesPullingTime="3.277742892s" totalInitContainerRuntime="1.16481775s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:49.774291488 +0000 UTC m=+393.340821360" watchObservedRunningTime="2026-07-06 19:29:49.777404168 +0000 UTC m=+393.343934021" Jul 06 19:30:00.742278 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:00.742247 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb8c7879-j6r4n" Jul 06 19:30:13.632460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.632420 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7"] Jul 06 19:30:13.635778 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.635756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.638798 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.638765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:30:13.638798 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.638788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:30:13.639022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.638883 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gs9s4\"" Jul 06 19:30:13.639022 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.638890 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:30:13.640208 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.640193 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:30:13.663582 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.663544 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7"] Jul 06 19:30:13.790472 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.790431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9725e90-85f0-4a3a-b803-bc48935e4eae-tls-certs\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.790472 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.790472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9725e90-85f0-4a3a-b803-bc48935e4eae-tmp\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.790710 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.790498 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvlb\" (UniqueName: \"kubernetes.io/projected/a9725e90-85f0-4a3a-b803-bc48935e4eae-kube-api-access-mjvlb\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.891119 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.891001 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9725e90-85f0-4a3a-b803-bc48935e4eae-tls-certs\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.891119 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.891039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9725e90-85f0-4a3a-b803-bc48935e4eae-tmp\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.891323 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.891163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvlb\" (UniqueName: \"kubernetes.io/projected/a9725e90-85f0-4a3a-b803-bc48935e4eae-kube-api-access-mjvlb\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.893334 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.893310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9725e90-85f0-4a3a-b803-bc48935e4eae-tmp\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.893545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.893526 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9725e90-85f0-4a3a-b803-bc48935e4eae-tls-certs\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.920952 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.920922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvlb\" (UniqueName: \"kubernetes.io/projected/a9725e90-85f0-4a3a-b803-bc48935e4eae-kube-api-access-mjvlb\") pod \"kube-auth-proxy-54bf5b454b-zlhm7\" (UID: \"a9725e90-85f0-4a3a-b803-bc48935e4eae\") " pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:13.945930 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:13.945888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" Jul 06 19:30:14.092157 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.092050 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7"] Jul 06 19:30:14.094417 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:30:14.094392 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9725e90_85f0_4a3a_b803_bc48935e4eae.slice/crio-ffd5d945f7a2f8ac99c404d359ea78b04fed73339239d3bcbb68c40ee5f125ae WatchSource:0}: Error finding container ffd5d945f7a2f8ac99c404d359ea78b04fed73339239d3bcbb68c40ee5f125ae: Status 404 returned error can't find the container with id ffd5d945f7a2f8ac99c404d359ea78b04fed73339239d3bcbb68c40ee5f125ae Jul 06 19:30:14.726545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.726506 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jw7gw"] Jul 06 19:30:14.729664 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.729638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.732375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.732350 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 19:30:14.744592 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.744562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jw7gw"] Jul 06 19:30:14.800545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.800410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx54\" (UniqueName: \"kubernetes.io/projected/35269ddd-65b4-4058-911d-737a1b97f342-kube-api-access-rmx54\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.800545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.800475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35269ddd-65b4-4058-911d-737a1b97f342-tls-certs\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.855812 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.855776 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" event={"ID":"a9725e90-85f0-4a3a-b803-bc48935e4eae","Type":"ContainerStarted","Data":"ffd5d945f7a2f8ac99c404d359ea78b04fed73339239d3bcbb68c40ee5f125ae"} Jul 06 19:30:14.896276 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.896237 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:14.900236 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.900214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:14.900929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.900901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35269ddd-65b4-4058-911d-737a1b97f342-tls-certs\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.901049 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.901020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx54\" (UniqueName: \"kubernetes.io/projected/35269ddd-65b4-4058-911d-737a1b97f342-kube-api-access-rmx54\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.903401 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903267 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:30:14.903401 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903284 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:30:14.903401 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903310 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:30:14.903401 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903319 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2qk76\"" Jul 06 19:30:14.903401 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903318 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:30:14.903712 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.903691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35269ddd-65b4-4058-911d-737a1b97f342-tls-certs\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:14.927675 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.927641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:14.943035 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:14.943000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx54\" (UniqueName: \"kubernetes.io/projected/35269ddd-65b4-4058-911d-737a1b97f342-kube-api-access-rmx54\") pod \"model-serving-api-54d89bd5fc-jw7gw\" (UID: \"35269ddd-65b4-4058-911d-737a1b97f342\") " pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:15.002343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002635 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvswk\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002635 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002635 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.002635 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.002527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.042365 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.042324 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:15.103591 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvswk\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103917 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.103951 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.103921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.105359 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.105313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.107631 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.106708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.107631 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.106713 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.107980 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.107944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.109227 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.109203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.115343 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.115313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.115642 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.115623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvswk\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk\") pod \"istiod-openshift-gateway-7574459656-47vtr\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.197962 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.197919 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jw7gw"] Jul 06 19:30:15.202561 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:30:15.202525 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35269ddd_65b4_4058_911d_737a1b97f342.slice/crio-d8f15e3e07456ed1aae3cb85aea76ca49031ab6d9284dc19514fac17ff56dbf1 WatchSource:0}: Error finding container d8f15e3e07456ed1aae3cb85aea76ca49031ab6d9284dc19514fac17ff56dbf1: Status 404 returned error can't find the container with id d8f15e3e07456ed1aae3cb85aea76ca49031ab6d9284dc19514fac17ff56dbf1 Jul 06 19:30:15.217251 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.217216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:15.380499 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.380473 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:15.382540 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:30:15.382511 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95b17ea_3305_47f0_ae78_5ec39cd5198a.slice/crio-8f64d96c6cf3d5a8a34b59899cb4fd819290e7078452c9f7859fd5aa9057a39b WatchSource:0}: Error finding container 8f64d96c6cf3d5a8a34b59899cb4fd819290e7078452c9f7859fd5aa9057a39b: Status 404 returned error can't find the container with id 8f64d96c6cf3d5a8a34b59899cb4fd819290e7078452c9f7859fd5aa9057a39b Jul 06 19:30:15.867632 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.867584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" event={"ID":"b95b17ea-3305-47f0-ae78-5ec39cd5198a","Type":"ContainerStarted","Data":"8f64d96c6cf3d5a8a34b59899cb4fd819290e7078452c9f7859fd5aa9057a39b"} Jul 06 19:30:15.869246 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:15.869213 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" event={"ID":"35269ddd-65b4-4058-911d-737a1b97f342","Type":"ContainerStarted","Data":"d8f15e3e07456ed1aae3cb85aea76ca49031ab6d9284dc19514fac17ff56dbf1"} Jul 06 19:30:18.670442 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.670403 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:18.670745 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.670472 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:30:18.673552 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.673527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:30:18.890792 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.890758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" event={"ID":"a9725e90-85f0-4a3a-b803-bc48935e4eae","Type":"ContainerStarted","Data":"8e5ba0f76a45d90c9da1adf7995d455aa33f60e10d18f5a5a65d891c80cd6d1f"} Jul 06 19:30:18.892439 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.892409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" event={"ID":"b95b17ea-3305-47f0-ae78-5ec39cd5198a","Type":"ContainerStarted","Data":"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b"} Jul 06 19:30:18.892620 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.892462 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:18.893985 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.893966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" event={"ID":"35269ddd-65b4-4058-911d-737a1b97f342","Type":"ContainerStarted","Data":"c3426c734b1484018e5f1a43bcd37242d551c3f3982439c4a74a7d1411e94274"} Jul 06 19:30:18.894131 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.894116 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:18.915452 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.915347 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54bf5b454b-zlhm7" podStartSLOduration=1.341346175 podStartE2EDuration="5.915329688s" totalImagesPullingTime="4.573983513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:18.913207518 +0000 UTC m=+422.479737371" watchObservedRunningTime="2026-07-06 19:30:18.915329688 +0000 UTC m=+422.481859541" Jul 06 19:30:18.952938 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.952870 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" podStartSLOduration=1.492877622 podStartE2EDuration="4.952847841s" totalImagesPullingTime="3.459970219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:18.951941883 +0000 UTC m=+422.518471762" watchObservedRunningTime="2026-07-06 19:30:18.952847841 +0000 UTC m=+422.519377695" Jul 06 19:30:18.979286 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:18.979218 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" podStartSLOduration=1.693652604 podStartE2EDuration="4.97920312s" totalImagesPullingTime="3.285550516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:18.978448078 +0000 UTC m=+422.544977942" watchObservedRunningTime="2026-07-06 19:30:18.97920312 +0000 UTC m=+422.545732971" Jul 06 19:30:19.900600 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:19.900563 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-47vtr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 19:30:19.900981 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:19.900634 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:30:22.899894 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:22.899862 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:24.004405 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.004367 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5"] Jul 06 19:30:24.006689 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.006670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.009428 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.009407 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 19:30:24.009555 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.009519 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9hxt8\"" Jul 06 19:30:24.016861 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.016832 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6"] Jul 06 19:30:24.019585 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.019564 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.022322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.022300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cqtqr\"" Jul 06 19:30:24.022439 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.022324 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 19:30:24.025654 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.025632 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5"] Jul 06 19:30:24.033620 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.033585 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6"] Jul 06 19:30:24.187356 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.187320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwmg\" (UniqueName: \"kubernetes.io/projected/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-kube-api-access-wfwmg\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.187356 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.187355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f4f21-7e9f-41ca-9b49-ff35e76e093b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.187570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.187393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-cert\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.187570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.187478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2ln2\" (UniqueName: \"kubernetes.io/projected/248f4f21-7e9f-41ca-9b49-ff35e76e093b-kube-api-access-q2ln2\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.288832 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.288738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2ln2\" (UniqueName: \"kubernetes.io/projected/248f4f21-7e9f-41ca-9b49-ff35e76e093b-kube-api-access-q2ln2\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.288832 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.288821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwmg\" (UniqueName: \"kubernetes.io/projected/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-kube-api-access-wfwmg\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.289034 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.288841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f4f21-7e9f-41ca-9b49-ff35e76e093b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.289034 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.288891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-cert\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.291507 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.291480 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-cert\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.291638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.291583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/248f4f21-7e9f-41ca-9b49-ff35e76e093b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.304238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.304207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2ln2\" (UniqueName: \"kubernetes.io/projected/248f4f21-7e9f-41ca-9b49-ff35e76e093b-kube-api-access-q2ln2\") pod \"llmisvc-controller-manager-777c6bd7d5-4skz6\" (UID: \"248f4f21-7e9f-41ca-9b49-ff35e76e093b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.304392 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.304314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwmg\" (UniqueName: \"kubernetes.io/projected/586eeb1e-ba1d-4495-96fd-b69d12bbf7f0-kube-api-access-wfwmg\") pod \"kserve-controller-manager-d6f4b65b8-zhpf5\" (UID: \"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.319206 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.319169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:24.331154 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.331124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:24.466230 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.466151 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5"] Jul 06 19:30:24.468907 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:30:24.468881 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586eeb1e_ba1d_4495_96fd_b69d12bbf7f0.slice/crio-1f95bb26755ac2e67575a5b14d6a62eae36900ac37409d29ab0d86dd450f5b03 WatchSource:0}: Error finding container 1f95bb26755ac2e67575a5b14d6a62eae36900ac37409d29ab0d86dd450f5b03: Status 404 returned error can't find the container with id 1f95bb26755ac2e67575a5b14d6a62eae36900ac37409d29ab0d86dd450f5b03 Jul 06 19:30:24.488600 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.488495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6"] Jul 06 19:30:24.490777 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:30:24.490752 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod248f4f21_7e9f_41ca_9b49_ff35e76e093b.slice/crio-a1f4fb057052f6e93122b52c847964d9d97ab499f5b265e1cd522c7530401430 WatchSource:0}: Error finding container a1f4fb057052f6e93122b52c847964d9d97ab499f5b265e1cd522c7530401430: Status 404 returned error can't find the container with id a1f4fb057052f6e93122b52c847964d9d97ab499f5b265e1cd522c7530401430 Jul 06 19:30:24.930358 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.930318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" event={"ID":"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0","Type":"ContainerStarted","Data":"1f95bb26755ac2e67575a5b14d6a62eae36900ac37409d29ab0d86dd450f5b03"} Jul 06 19:30:24.931422 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:24.931399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" event={"ID":"248f4f21-7e9f-41ca-9b49-ff35e76e093b","Type":"ContainerStarted","Data":"a1f4fb057052f6e93122b52c847964d9d97ab499f5b265e1cd522c7530401430"} Jul 06 19:30:27.949944 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:27.949912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" event={"ID":"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0","Type":"ContainerStarted","Data":"bf955cf01646ea07291773c342d794b1d5328035c3510c264e77e14a7b896f3d"} Jul 06 19:30:27.950300 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:27.950047 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:30:27.970020 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:27.969959 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" podStartSLOduration=2.173291858 podStartE2EDuration="4.969938794s" totalImagesPullingTime="2.796646936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:27.969459963 +0000 UTC m=+431.535989817" watchObservedRunningTime="2026-07-06 19:30:27.969938794 +0000 UTC m=+431.536468647" Jul 06 19:30:28.854468 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.854432 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:28.854650 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.854627 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" containerID="cri-o://e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b" gracePeriod=30 Jul 06 19:30:28.898938 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.898906 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-47vtr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:8080/ready\": dial tcp 10.133.0.32:8080: connect: connection refused" start-of-body= Jul 06 19:30:28.899071 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.898958 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.32:8080/ready\": dial tcp 10.133.0.32:8080: connect: connection refused" Jul 06 19:30:28.956062 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.956026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" event={"ID":"248f4f21-7e9f-41ca-9b49-ff35e76e093b","Type":"ContainerStarted","Data":"a82895dddff5704f891de13c73966389533154efc13910f45ff4ea1d295141d0"} Jul 06 19:30:28.976973 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:28.976922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" podStartSLOduration=2.538783546 podStartE2EDuration="5.976904501s" totalImagesPullingTime="3.438120955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:28.975365423 +0000 UTC m=+432.541895276" watchObservedRunningTime="2026-07-06 19:30:28.976904501 +0000 UTC m=+432.543434354" Jul 06 19:30:29.102090 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.102065 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:29.235151 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235073 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235186 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235250 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235276 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235313 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvswk\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235531 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235357 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235531 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235426 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts\") pod \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\" (UID: \"b95b17ea-3305-47f0-ae78-5ec39cd5198a\") " Jul 06 19:30:29.235638 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235574 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:29.235698 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.235685 2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-ca-configmap\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.237688 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.237633 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:30:29.237828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.237691 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:29.237963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.237934 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:30:29.237963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.237943 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk" (OuterVolumeSpecName: "kube-api-access-lvswk") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "kube-api-access-lvswk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:29.238164 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.237995 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs" (OuterVolumeSpecName: "local-certs") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:30:29.238164 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.238012 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts" (OuterVolumeSpecName: "cacerts") pod "b95b17ea-3305-47f0-ae78-5ec39cd5198a" (UID: "b95b17ea-3305-47f0-ae78-5ec39cd5198a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:30:29.336906 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336866 2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-cacerts\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.336906 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336899 2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-csr-dns-cert\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.336906 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336909 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-token\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.336906 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336919 2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95b17ea-3305-47f0-ae78-5ec39cd5198a-local-certs\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.337246 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336933 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvswk\" (UniqueName: \"kubernetes.io/projected/b95b17ea-3305-47f0-ae78-5ec39cd5198a-kube-api-access-lvswk\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.337246 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.336944 2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b95b17ea-3305-47f0-ae78-5ec39cd5198a-istio-kubeconfig\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:30:29.902388 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.902359 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jw7gw" Jul 06 19:30:29.962712 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.962678 2558 generic.go:356] "Generic (PLEG): container finished" podID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerID="e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b" exitCode=0 Jul 06 19:30:29.963169 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.962740 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" Jul 06 19:30:29.963169 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.962761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" event={"ID":"b95b17ea-3305-47f0-ae78-5ec39cd5198a","Type":"ContainerDied","Data":"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b"} Jul 06 19:30:29.963169 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.962809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-47vtr" event={"ID":"b95b17ea-3305-47f0-ae78-5ec39cd5198a","Type":"ContainerDied","Data":"8f64d96c6cf3d5a8a34b59899cb4fd819290e7078452c9f7859fd5aa9057a39b"} Jul 06 19:30:29.963169 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.962835 2558 scope.go:117] "RemoveContainer" containerID="e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b" Jul 06 19:30:29.963681 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.963658 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:30:29.974750 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.974733 2558 scope.go:117] "RemoveContainer" containerID="e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b" Jul 06 19:30:29.975141 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:30:29.975116 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b\": container with ID starting with e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b not found: ID does not exist" containerID="e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b" Jul 06 19:30:29.975214 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.975148 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b"} err="failed to get container status \"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b\": rpc error: code = NotFound desc = could not find container \"e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b\": container with ID starting with e6b9762a502a3cdf21a8e33c5878acfffa50df196985d723d6b4eee5107b0f4b not found: ID does not exist" Jul 06 19:30:29.995244 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.995215 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:29.997252 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:29.997228 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-47vtr"] Jul 06 19:30:30.966481 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:30.966444 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" path="/var/lib/kubelet/pods/b95b17ea-3305-47f0-ae78-5ec39cd5198a/volumes" Jul 06 19:30:58.965173 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:30:58.965146 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:31:00.972488 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:00.972457 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:31:14.439578 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.439539 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:14.440005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.439930 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" Jul 06 19:31:14.440005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.439944 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" Jul 06 19:31:14.440085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.440012 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95b17ea-3305-47f0-ae78-5ec39cd5198a" containerName="discovery" Jul 06 19:31:14.442854 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.442836 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:14.447430 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.447406 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:31:14.447575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.447406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lxk7v\"" Jul 06 19:31:14.447575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.447406 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:31:14.454424 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.454395 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:14.632038 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.631994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv965\" (UniqueName: \"kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965\") pod \"kuadrant-operator-catalog-26vls\" (UID: \"6910cf5e-28cb-4bc6-8a60-ae2bed482d91\") " pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:14.733339 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.733242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv965\" (UniqueName: \"kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965\") pod \"kuadrant-operator-catalog-26vls\" (UID: \"6910cf5e-28cb-4bc6-8a60-ae2bed482d91\") " pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:14.743744 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.743711 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv965\" (UniqueName: \"kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965\") pod \"kuadrant-operator-catalog-26vls\" (UID: \"6910cf5e-28cb-4bc6-8a60-ae2bed482d91\") " pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:14.754491 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.754463 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:14.778166 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.778127 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:14.898800 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.898762 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:14.901399 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:14.901374 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6910cf5e_28cb_4bc6_8a60_ae2bed482d91.slice/crio-49bef184a53c5efe02b5391d1e00af2be60ec3d8b068050e58fb518902fdec61 WatchSource:0}: Error finding container 49bef184a53c5efe02b5391d1e00af2be60ec3d8b068050e58fb518902fdec61: Status 404 returned error can't find the container with id 49bef184a53c5efe02b5391d1e00af2be60ec3d8b068050e58fb518902fdec61 Jul 06 19:31:14.983283 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.983254 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p49d"] Jul 06 19:31:14.987644 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:14.987603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:15.000287 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.000259 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p49d"] Jul 06 19:31:15.136686 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.136640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfxr\" (UniqueName: \"kubernetes.io/projected/d0d8d918-5760-4c77-a180-7a3f937a3fa1-kube-api-access-gdfxr\") pod \"kuadrant-operator-catalog-8p49d\" (UID: \"d0d8d918-5760-4c77-a180-7a3f937a3fa1\") " pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:15.192543 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.192510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26vls" event={"ID":"6910cf5e-28cb-4bc6-8a60-ae2bed482d91","Type":"ContainerStarted","Data":"49bef184a53c5efe02b5391d1e00af2be60ec3d8b068050e58fb518902fdec61"} Jul 06 19:31:15.238084 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.237988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfxr\" (UniqueName: \"kubernetes.io/projected/d0d8d918-5760-4c77-a180-7a3f937a3fa1-kube-api-access-gdfxr\") pod \"kuadrant-operator-catalog-8p49d\" (UID: \"d0d8d918-5760-4c77-a180-7a3f937a3fa1\") " pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:15.251041 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.251007 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdfxr\" (UniqueName: \"kubernetes.io/projected/d0d8d918-5760-4c77-a180-7a3f937a3fa1-kube-api-access-gdfxr\") pod \"kuadrant-operator-catalog-8p49d\" (UID: \"d0d8d918-5760-4c77-a180-7a3f937a3fa1\") " pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:15.297545 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.297513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:15.445699 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:15.445671 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8p49d"] Jul 06 19:31:15.446995 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:15.446967 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d8d918_5760_4c77_a180_7a3f937a3fa1.slice/crio-e15378d1a6b3ebfbda9988928a7d047586cb2a87ed43a6ad94cc6f92f32fbbe5 WatchSource:0}: Error finding container e15378d1a6b3ebfbda9988928a7d047586cb2a87ed43a6ad94cc6f92f32fbbe5: Status 404 returned error can't find the container with id e15378d1a6b3ebfbda9988928a7d047586cb2a87ed43a6ad94cc6f92f32fbbe5 Jul 06 19:31:16.200742 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:16.200705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" event={"ID":"d0d8d918-5760-4c77-a180-7a3f937a3fa1","Type":"ContainerStarted","Data":"e15378d1a6b3ebfbda9988928a7d047586cb2a87ed43a6ad94cc6f92f32fbbe5"} Jul 06 19:31:17.207613 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.207488 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26vls" event={"ID":"6910cf5e-28cb-4bc6-8a60-ae2bed482d91","Type":"ContainerStarted","Data":"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942"} Jul 06 19:31:17.207613 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.207533 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-26vls" podUID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" containerName="registry-server" containerID="cri-o://372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942" gracePeriod=2 Jul 06 19:31:17.209140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.209090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" event={"ID":"d0d8d918-5760-4c77-a180-7a3f937a3fa1","Type":"ContainerStarted","Data":"e4786902244e2ac8aec8392ae5451f12826b28c588cf234f822f4b69805e0c1b"} Jul 06 19:31:17.229272 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.229218 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-26vls" podStartSLOduration=1.15385659 podStartE2EDuration="3.229202122s" totalImagesPullingTime="2.075345532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:17.227370497 +0000 UTC m=+480.793900374" watchObservedRunningTime="2026-07-06 19:31:17.229202122 +0000 UTC m=+480.795731976" Jul 06 19:31:17.464004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.463938 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:17.483755 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.483708 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" podStartSLOduration=1.952934515 podStartE2EDuration="3.483690129s" totalImagesPullingTime="1.530755614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:17.253928263 +0000 UTC m=+480.820458116" watchObservedRunningTime="2026-07-06 19:31:17.483690129 +0000 UTC m=+481.050219981" Jul 06 19:31:17.558283 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.558242 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv965\" (UniqueName: \"kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965\") pod \"6910cf5e-28cb-4bc6-8a60-ae2bed482d91\" (UID: \"6910cf5e-28cb-4bc6-8a60-ae2bed482d91\") " Jul 06 19:31:17.560422 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.560398 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965" (OuterVolumeSpecName: "kube-api-access-lv965") pod "6910cf5e-28cb-4bc6-8a60-ae2bed482d91" (UID: "6910cf5e-28cb-4bc6-8a60-ae2bed482d91"). InnerVolumeSpecName "kube-api-access-lv965". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:17.659128 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:17.659064 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv965\" (UniqueName: \"kubernetes.io/projected/6910cf5e-28cb-4bc6-8a60-ae2bed482d91-kube-api-access-lv965\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:18.214985 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.214948 2558 generic.go:356] "Generic (PLEG): container finished" podID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" containerID="372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942" exitCode=0 Jul 06 19:31:18.215412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.214992 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-26vls" Jul 06 19:31:18.215412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.215023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26vls" event={"ID":"6910cf5e-28cb-4bc6-8a60-ae2bed482d91","Type":"ContainerDied","Data":"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942"} Jul 06 19:31:18.215412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.215072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-26vls" event={"ID":"6910cf5e-28cb-4bc6-8a60-ae2bed482d91","Type":"ContainerDied","Data":"49bef184a53c5efe02b5391d1e00af2be60ec3d8b068050e58fb518902fdec61"} Jul 06 19:31:18.215412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.215093 2558 scope.go:117] "RemoveContainer" containerID="372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942" Jul 06 19:31:18.225514 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.225496 2558 scope.go:117] "RemoveContainer" containerID="372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942" Jul 06 19:31:18.225833 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:31:18.225809 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942\": container with ID starting with 372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942 not found: ID does not exist" containerID="372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942" Jul 06 19:31:18.225934 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.225840 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942"} err="failed to get container status \"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942\": rpc error: code = NotFound desc = could not find container \"372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942\": container with ID starting with 372f0c9416df2cf3e82747010e9a7f60d1fe1da729961d36e4daeae03e5ec942 not found: ID does not exist" Jul 06 19:31:18.241540 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.241513 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:18.245019 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.244994 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-26vls"] Jul 06 19:31:18.965579 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:18.965545 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" path="/var/lib/kubelet/pods/6910cf5e-28cb-4bc6-8a60-ae2bed482d91/volumes" Jul 06 19:31:25.298119 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:25.298059 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:25.298605 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:25.298146 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:25.320960 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:25.320931 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:26.276511 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:26.276480 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8p49d" Jul 06 19:31:30.228475 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.228434 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p"] Jul 06 19:31:30.228963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.228772 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" containerName="registry-server" Jul 06 19:31:30.228963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.228782 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" containerName="registry-server" Jul 06 19:31:30.228963 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.228859 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6910cf5e-28cb-4bc6-8a60-ae2bed482d91" containerName="registry-server" Jul 06 19:31:30.233451 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.233431 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.236226 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.236203 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vpt7f\"" Jul 06 19:31:30.242006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.241983 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p"] Jul 06 19:31:30.272712 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.272680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.272886 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.272738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.272886 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.272756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlch\" (UniqueName: \"kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.374173 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.374126 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.374173 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.374176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlch\" (UniqueName: \"kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.374432 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.374270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.374614 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.374594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.374614 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.374605 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.387981 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.387953 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlch\" (UniqueName: \"kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.543872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.543776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:30.687218 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.687188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p"] Jul 06 19:31:30.689404 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:30.689378 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0efae6d_d392_465e_88a2_f144f50d5efe.slice/crio-d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34 WatchSource:0}: Error finding container d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34: Status 404 returned error can't find the container with id d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34 Jul 06 19:31:30.822780 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.822739 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz"] Jul 06 19:31:30.826411 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.826392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.835012 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.834979 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz"] Jul 06 19:31:30.877372 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.877327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.877549 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.877387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxsn7\" (UniqueName: \"kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.877549 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.877468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.978460 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.978418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.978633 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.978475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxsn7\" (UniqueName: \"kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.978633 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.978502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.978863 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.978849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.978901 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.978848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:30.989506 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:30.989473 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxsn7\" (UniqueName: \"kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:31.165927 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.165885 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:31.231782 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.231750 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg"] Jul 06 19:31:31.236352 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.236330 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.244603 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.244575 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg"] Jul 06 19:31:31.281152 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfwn\" (UniqueName: \"kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.281337 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.281337 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.281546 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281524 2558 generic.go:356] "Generic (PLEG): container finished" podID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerID="07fc84ce3794b255193fdaf1ee6f259cf44f0de45b08159b3e089622d8b2f1f8" exitCode=0 Jul 06 19:31:31.281622 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281605 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" event={"ID":"b0efae6d-d392-465e-88a2-f144f50d5efe","Type":"ContainerDied","Data":"07fc84ce3794b255193fdaf1ee6f259cf44f0de45b08159b3e089622d8b2f1f8"} Jul 06 19:31:31.281676 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.281655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" event={"ID":"b0efae6d-d392-465e-88a2-f144f50d5efe","Type":"ContainerStarted","Data":"d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34"} Jul 06 19:31:31.306942 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.306916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz"] Jul 06 19:31:31.308395 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:31.308370 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfcf368_5af2_4204_a4b6_000561c45ef3.slice/crio-713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde WatchSource:0}: Error finding container 713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde: Status 404 returned error can't find the container with id 713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde Jul 06 19:31:31.382189 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.382129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfwn\" (UniqueName: \"kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.382390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.382217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.382390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.382349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.382928 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.382901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.383053 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.382902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.393605 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.393563 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfwn\" (UniqueName: \"kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.547686 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.547587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:31.633717 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.633684 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22"] Jul 06 19:31:31.638618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.638591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.651006 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.650966 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22"] Jul 06 19:31:31.685446 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.685415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.685618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.685455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.685618 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.685518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcc5\" (UniqueName: \"kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.703238 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.703214 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg"] Jul 06 19:31:31.704823 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:31.704792 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a8e309_ce16_4419_bedd_290935746853.slice/crio-adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f WatchSource:0}: Error finding container adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f: Status 404 returned error can't find the container with id adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f Jul 06 19:31:31.786403 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.786368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.786403 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.786407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.786687 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.786442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcc5\" (UniqueName: \"kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.786830 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.786804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.786830 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.786816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.800515 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.800427 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcc5\" (UniqueName: \"kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:31.950710 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:31.950660 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:32.114400 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.114347 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22"] Jul 06 19:31:32.128974 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:32.128937 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816ccab4_7d0b_42e3_9aa8_ef05815a3214.slice/crio-2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43 WatchSource:0}: Error finding container 2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43: Status 404 returned error can't find the container with id 2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43 Jul 06 19:31:32.287890 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.287848 2558 generic.go:356] "Generic (PLEG): container finished" podID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerID="3567667fc1df3c29525a05b4f8804e6c1772e6fd99835069637d13905df87ec5" exitCode=0 Jul 06 19:31:32.288309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.287931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" event={"ID":"bcfcf368-5af2-4204-a4b6-000561c45ef3","Type":"ContainerDied","Data":"3567667fc1df3c29525a05b4f8804e6c1772e6fd99835069637d13905df87ec5"} Jul 06 19:31:32.288309 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.287983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" event={"ID":"bcfcf368-5af2-4204-a4b6-000561c45ef3","Type":"ContainerStarted","Data":"713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde"} Jul 06 19:31:32.290039 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.290012 2558 generic.go:356] "Generic (PLEG): container finished" podID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerID="3e026ee3eb6e786d6ef53d8e75daba59258254d89317f4ffc9b2c65899df7349" exitCode=0 Jul 06 19:31:32.290191 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.290044 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" event={"ID":"b0efae6d-d392-465e-88a2-f144f50d5efe","Type":"ContainerDied","Data":"3e026ee3eb6e786d6ef53d8e75daba59258254d89317f4ffc9b2c65899df7349"} Jul 06 19:31:32.291707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.291670 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4a8e309-ce16-4419-bedd-290935746853" containerID="0d25303260a39a4882ad6526ddc8bd9e27c919571d28e3f0ba5ea3e431baffaf" exitCode=0 Jul 06 19:31:32.291789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.291751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" event={"ID":"c4a8e309-ce16-4419-bedd-290935746853","Type":"ContainerDied","Data":"0d25303260a39a4882ad6526ddc8bd9e27c919571d28e3f0ba5ea3e431baffaf"} Jul 06 19:31:32.291853 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.291793 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" event={"ID":"c4a8e309-ce16-4419-bedd-290935746853","Type":"ContainerStarted","Data":"adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f"} Jul 06 19:31:32.293606 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.293584 2558 generic.go:356] "Generic (PLEG): container finished" podID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerID="3a5d2bf72ab5485aa157e03f0783f56a422bc348b967a6a81bd7566a751d10fc" exitCode=0 Jul 06 19:31:32.293711 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.293655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" event={"ID":"816ccab4-7d0b-42e3-9aa8-ef05815a3214","Type":"ContainerDied","Data":"3a5d2bf72ab5485aa157e03f0783f56a422bc348b967a6a81bd7566a751d10fc"} Jul 06 19:31:32.293711 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:32.293698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" event={"ID":"816ccab4-7d0b-42e3-9aa8-ef05815a3214","Type":"ContainerStarted","Data":"2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43"} Jul 06 19:31:33.301225 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:33.301195 2558 generic.go:356] "Generic (PLEG): container finished" podID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerID="d63780ce35a73eae62afe899dc76bbe51ecb7aa78f87cbf503763f1698798c22" exitCode=0 Jul 06 19:31:33.301694 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:33.301285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" event={"ID":"816ccab4-7d0b-42e3-9aa8-ef05815a3214","Type":"ContainerDied","Data":"d63780ce35a73eae62afe899dc76bbe51ecb7aa78f87cbf503763f1698798c22"} Jul 06 19:31:33.303604 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:33.303575 2558 generic.go:356] "Generic (PLEG): container finished" podID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerID="136aa64aba6d35adf8d44f7af78b38c13bee36c14531b1501974fcf907de2f22" exitCode=0 Jul 06 19:31:33.303699 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:33.303622 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" event={"ID":"b0efae6d-d392-465e-88a2-f144f50d5efe","Type":"ContainerDied","Data":"136aa64aba6d35adf8d44f7af78b38c13bee36c14531b1501974fcf907de2f22"} Jul 06 19:31:34.311118 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.311067 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4a8e309-ce16-4419-bedd-290935746853" containerID="3cf18e28549a17b7381c9d4239d23066165fc1efa9df94e7de3cea61c38bd98e" exitCode=0 Jul 06 19:31:34.311530 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.311141 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" event={"ID":"c4a8e309-ce16-4419-bedd-290935746853","Type":"ContainerDied","Data":"3cf18e28549a17b7381c9d4239d23066165fc1efa9df94e7de3cea61c38bd98e"} Jul 06 19:31:34.313390 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.313366 2558 generic.go:356] "Generic (PLEG): container finished" podID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerID="3cd8ce030d1742d38615338b0919e3ca7b761e9065a4f766115f3b5346247fe7" exitCode=0 Jul 06 19:31:34.313492 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.313451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" event={"ID":"816ccab4-7d0b-42e3-9aa8-ef05815a3214","Type":"ContainerDied","Data":"3cd8ce030d1742d38615338b0919e3ca7b761e9065a4f766115f3b5346247fe7"} Jul 06 19:31:34.315064 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.315047 2558 generic.go:356] "Generic (PLEG): container finished" podID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerID="402b905b042b5150390e13a312045cb77b340bdbb04695ea62c4f3e7c4ab9e31" exitCode=0 Jul 06 19:31:34.315153 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.315132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" event={"ID":"bcfcf368-5af2-4204-a4b6-000561c45ef3","Type":"ContainerDied","Data":"402b905b042b5150390e13a312045cb77b340bdbb04695ea62c4f3e7c4ab9e31"} Jul 06 19:31:34.549354 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.549325 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:34.611381 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.611282 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle\") pod \"b0efae6d-d392-465e-88a2-f144f50d5efe\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " Jul 06 19:31:34.611381 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.611341 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmlch\" (UniqueName: \"kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch\") pod \"b0efae6d-d392-465e-88a2-f144f50d5efe\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " Jul 06 19:31:34.611608 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.611390 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util\") pod \"b0efae6d-d392-465e-88a2-f144f50d5efe\" (UID: \"b0efae6d-d392-465e-88a2-f144f50d5efe\") " Jul 06 19:31:34.611848 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.611824 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle" (OuterVolumeSpecName: "bundle") pod "b0efae6d-d392-465e-88a2-f144f50d5efe" (UID: "b0efae6d-d392-465e-88a2-f144f50d5efe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:34.613457 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.613427 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch" (OuterVolumeSpecName: "kube-api-access-jmlch") pod "b0efae6d-d392-465e-88a2-f144f50d5efe" (UID: "b0efae6d-d392-465e-88a2-f144f50d5efe"). InnerVolumeSpecName "kube-api-access-jmlch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:34.617027 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.617007 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util" (OuterVolumeSpecName: "util") pod "b0efae6d-d392-465e-88a2-f144f50d5efe" (UID: "b0efae6d-d392-465e-88a2-f144f50d5efe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:34.712554 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.712513 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:34.712554 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.712547 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmlch\" (UniqueName: \"kubernetes.io/projected/b0efae6d-d392-465e-88a2-f144f50d5efe-kube-api-access-jmlch\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:34.712554 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:34.712556 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0efae6d-d392-465e-88a2-f144f50d5efe-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.323617 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.323534 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" Jul 06 19:31:35.324057 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.323524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p" event={"ID":"b0efae6d-d392-465e-88a2-f144f50d5efe","Type":"ContainerDied","Data":"d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34"} Jul 06 19:31:35.324057 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.323664 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d176c2db44180755498b709209c7bb10fcdd4b7ceb7fdee1b75c7d6ce0b38c34" Jul 06 19:31:35.325850 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.325806 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4a8e309-ce16-4419-bedd-290935746853" containerID="b126b18bdaa0dac990a338a4f558c73d8457efacd5322d9268cea38a09a28c7a" exitCode=0 Jul 06 19:31:35.325986 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.325935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" event={"ID":"c4a8e309-ce16-4419-bedd-290935746853","Type":"ContainerDied","Data":"b126b18bdaa0dac990a338a4f558c73d8457efacd5322d9268cea38a09a28c7a"} Jul 06 19:31:35.327836 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.327811 2558 generic.go:356] "Generic (PLEG): container finished" podID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerID="cc9cdaa964ca661bf650a0126bdae058173b04b2b337a11f0da083a467b460d1" exitCode=0 Jul 06 19:31:35.327954 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.327895 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" event={"ID":"bcfcf368-5af2-4204-a4b6-000561c45ef3","Type":"ContainerDied","Data":"cc9cdaa964ca661bf650a0126bdae058173b04b2b337a11f0da083a467b460d1"} Jul 06 19:31:35.460879 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.460852 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:35.519807 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.519769 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle\") pod \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " Jul 06 19:31:35.520007 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.519823 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpcc5\" (UniqueName: \"kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5\") pod \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " Jul 06 19:31:35.520007 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.519877 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util\") pod \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\" (UID: \"816ccab4-7d0b-42e3-9aa8-ef05815a3214\") " Jul 06 19:31:35.520457 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.520429 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle" (OuterVolumeSpecName: "bundle") pod "816ccab4-7d0b-42e3-9aa8-ef05815a3214" (UID: "816ccab4-7d0b-42e3-9aa8-ef05815a3214"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.522058 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.522038 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5" (OuterVolumeSpecName: "kube-api-access-hpcc5") pod "816ccab4-7d0b-42e3-9aa8-ef05815a3214" (UID: "816ccab4-7d0b-42e3-9aa8-ef05815a3214"). InnerVolumeSpecName "kube-api-access-hpcc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:35.525420 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.525399 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util" (OuterVolumeSpecName: "util") pod "816ccab4-7d0b-42e3-9aa8-ef05815a3214" (UID: "816ccab4-7d0b-42e3-9aa8-ef05815a3214"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:35.620559 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.620529 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.620559 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.620559 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/816ccab4-7d0b-42e3-9aa8-ef05815a3214-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:35.620748 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:35.620568 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpcc5\" (UniqueName: \"kubernetes.io/projected/816ccab4-7d0b-42e3-9aa8-ef05815a3214-kube-api-access-hpcc5\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.335612 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.335585 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" Jul 06 19:31:36.336085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.335621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22" event={"ID":"816ccab4-7d0b-42e3-9aa8-ef05815a3214","Type":"ContainerDied","Data":"2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43"} Jul 06 19:31:36.336085 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.335675 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b31f16212a9ed446a7b0727f8e25854b5e063e9a84279e46bb4a96703437c43" Jul 06 19:31:36.497017 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.496990 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:36.499144 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.499123 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:36.628518 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628479 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle\") pod \"c4a8e309-ce16-4419-bedd-290935746853\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " Jul 06 19:31:36.628682 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628537 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util\") pod \"c4a8e309-ce16-4419-bedd-290935746853\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " Jul 06 19:31:36.628682 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628568 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle\") pod \"bcfcf368-5af2-4204-a4b6-000561c45ef3\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " Jul 06 19:31:36.628682 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628595 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util\") pod \"bcfcf368-5af2-4204-a4b6-000561c45ef3\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " Jul 06 19:31:36.628682 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628618 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mfwn\" (UniqueName: \"kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn\") pod \"c4a8e309-ce16-4419-bedd-290935746853\" (UID: \"c4a8e309-ce16-4419-bedd-290935746853\") " Jul 06 19:31:36.628682 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.628651 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxsn7\" (UniqueName: \"kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7\") pod \"bcfcf368-5af2-4204-a4b6-000561c45ef3\" (UID: \"bcfcf368-5af2-4204-a4b6-000561c45ef3\") " Jul 06 19:31:36.629073 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.629041 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle" (OuterVolumeSpecName: "bundle") pod "c4a8e309-ce16-4419-bedd-290935746853" (UID: "c4a8e309-ce16-4419-bedd-290935746853"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:36.629227 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.629161 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle" (OuterVolumeSpecName: "bundle") pod "bcfcf368-5af2-4204-a4b6-000561c45ef3" (UID: "bcfcf368-5af2-4204-a4b6-000561c45ef3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:36.630843 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.630813 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn" (OuterVolumeSpecName: "kube-api-access-8mfwn") pod "c4a8e309-ce16-4419-bedd-290935746853" (UID: "c4a8e309-ce16-4419-bedd-290935746853"). InnerVolumeSpecName "kube-api-access-8mfwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:36.630953 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.630857 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7" (OuterVolumeSpecName: "kube-api-access-vxsn7") pod "bcfcf368-5af2-4204-a4b6-000561c45ef3" (UID: "bcfcf368-5af2-4204-a4b6-000561c45ef3"). InnerVolumeSpecName "kube-api-access-vxsn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:36.634360 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.634333 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util" (OuterVolumeSpecName: "util") pod "c4a8e309-ce16-4419-bedd-290935746853" (UID: "c4a8e309-ce16-4419-bedd-290935746853"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:36.665138 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.665074 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util" (OuterVolumeSpecName: "util") pod "bcfcf368-5af2-4204-a4b6-000561c45ef3" (UID: "bcfcf368-5af2-4204-a4b6-000561c45ef3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:36.730010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.729968 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.730010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.730001 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4a8e309-ce16-4419-bedd-290935746853-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.730010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.730011 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-bundle\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.730010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.730018 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcfcf368-5af2-4204-a4b6-000561c45ef3-util\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.730311 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.730029 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mfwn\" (UniqueName: \"kubernetes.io/projected/c4a8e309-ce16-4419-bedd-290935746853-kube-api-access-8mfwn\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:36.730311 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:36.730039 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxsn7\" (UniqueName: \"kubernetes.io/projected/bcfcf368-5af2-4204-a4b6-000561c45ef3-kube-api-access-vxsn7\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:31:37.342828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.342739 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" Jul 06 19:31:37.342828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.342770 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg" event={"ID":"c4a8e309-ce16-4419-bedd-290935746853","Type":"ContainerDied","Data":"adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f"} Jul 06 19:31:37.342828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.342823 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adf374cef5cecdf4b7b7c3647a013da74759be3082f1f0d5dd2550f3f4df1e1f" Jul 06 19:31:37.344762 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.344739 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" Jul 06 19:31:37.344888 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.344737 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz" event={"ID":"bcfcf368-5af2-4204-a4b6-000561c45ef3","Type":"ContainerDied","Data":"713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde"} Jul 06 19:31:37.344888 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:37.344871 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="713c8939ed5fb52abc0d57d630434fa134edb68a12ea661bc6bbc835b0502dde" Jul 06 19:31:45.805661 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.805627 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj"] Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806141 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="extract" Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806168 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="extract" Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806183 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="extract" Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806190 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="extract" Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806205 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="util" Jul 06 19:31:45.806210 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806214 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806225 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806233 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806245 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806253 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806266 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806274 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806283 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806291 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806302 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806313 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806321 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806329 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806356 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806365 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="util" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806377 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806385 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806396 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806405 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="pull" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806492 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0efae6d-d392-465e-88a2-f144f50d5efe" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806508 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="816ccab4-7d0b-42e3-9aa8-ef05815a3214" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806520 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a8e309-ce16-4419-bedd-290935746853" containerName="extract" Jul 06 19:31:45.806575 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.806529 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfcf368-5af2-4204-a4b6-000561c45ef3" containerName="extract" Jul 06 19:31:45.811902 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.811876 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:45.814904 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.814881 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rmbts\"" Jul 06 19:31:45.819289 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.819089 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj"] Jul 06 19:31:45.910491 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:45.910448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5fk\" (UniqueName: \"kubernetes.io/projected/f3b8181b-fcb0-4df3-97c3-0ddfeaa40047-kube-api-access-np5fk\") pod \"authorino-operator-75cc8d5cb7-wcdqj\" (UID: \"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:46.010990 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:46.010948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5fk\" (UniqueName: \"kubernetes.io/projected/f3b8181b-fcb0-4df3-97c3-0ddfeaa40047-kube-api-access-np5fk\") pod \"authorino-operator-75cc8d5cb7-wcdqj\" (UID: \"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:46.020246 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:46.020219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5fk\" (UniqueName: \"kubernetes.io/projected/f3b8181b-fcb0-4df3-97c3-0ddfeaa40047-kube-api-access-np5fk\") pod \"authorino-operator-75cc8d5cb7-wcdqj\" (UID: \"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:46.122987 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:46.122950 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:46.258834 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:46.258807 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj"] Jul 06 19:31:46.261381 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:46.261353 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b8181b_fcb0_4df3_97c3_0ddfeaa40047.slice/crio-664f7b84d2413a94d6dd0b76a0c87141ffc3650063ec59d8b6850cbbce9354e9 WatchSource:0}: Error finding container 664f7b84d2413a94d6dd0b76a0c87141ffc3650063ec59d8b6850cbbce9354e9: Status 404 returned error can't find the container with id 664f7b84d2413a94d6dd0b76a0c87141ffc3650063ec59d8b6850cbbce9354e9 Jul 06 19:31:46.393035 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:46.392949 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" event={"ID":"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047","Type":"ContainerStarted","Data":"664f7b84d2413a94d6dd0b76a0c87141ffc3650063ec59d8b6850cbbce9354e9"} Jul 06 19:31:49.411776 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:49.411740 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" event={"ID":"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047","Type":"ContainerStarted","Data":"0115732be0c27f2cdd5f3717030686f890c264c46e99c53f9623cf53b0f0534f"} Jul 06 19:31:49.412168 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:49.411818 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:31:49.434285 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:49.434227 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" podStartSLOduration=2.294543847 podStartE2EDuration="4.434208526s" totalImagesPullingTime="2.139664679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:49.432509163 +0000 UTC m=+512.999039016" watchObservedRunningTime="2026-07-06 19:31:49.434208526 +0000 UTC m=+513.000738381" Jul 06 19:31:52.147697 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.147658 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x"] Jul 06 19:31:52.154171 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.154141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.160616 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.160517 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ft7g9\"" Jul 06 19:31:52.172281 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.172248 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x"] Jul 06 19:31:52.268755 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.268709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.268972 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.268798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gjb6\" (UniqueName: \"kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.369353 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.369317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.369513 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.369381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gjb6\" (UniqueName: \"kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.369784 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.369760 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.396142 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.396092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gjb6\" (UniqueName: \"kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.464005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.463904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:31:52.637722 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:52.637691 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x"] Jul 06 19:31:52.639649 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:52.639613 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069dc6a9_91d1_4e24_ad2e_27673aeedda2.slice/crio-7d40d65f1a59d38e03cf3ce3166c08f3188440cd1606bb4972686c230631b124 WatchSource:0}: Error finding container 7d40d65f1a59d38e03cf3ce3166c08f3188440cd1606bb4972686c230631b124: Status 404 returned error can't find the container with id 7d40d65f1a59d38e03cf3ce3166c08f3188440cd1606bb4972686c230631b124 Jul 06 19:31:53.435353 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:53.435308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" event={"ID":"069dc6a9-91d1-4e24-ad2e-27673aeedda2","Type":"ContainerStarted","Data":"7d40d65f1a59d38e03cf3ce3166c08f3188440cd1606bb4972686c230631b124"} Jul 06 19:31:54.967531 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:54.967501 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns"] Jul 06 19:31:54.971852 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:54.971828 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:54.975193 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:54.975147 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 19:31:54.975534 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:54.975511 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-85w6f\"" Jul 06 19:31:54.976735 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:54.976711 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns"] Jul 06 19:31:55.095199 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.095166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb492\" (UniqueName: \"kubernetes.io/projected/3828fcac-2770-4441-b718-5255990d2d2e-kube-api-access-zb492\") pod \"dns-operator-controller-manager-864dd78c4c-f4jns\" (UID: \"3828fcac-2770-4441-b718-5255990d2d2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:55.196057 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.196000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb492\" (UniqueName: \"kubernetes.io/projected/3828fcac-2770-4441-b718-5255990d2d2e-kube-api-access-zb492\") pod \"dns-operator-controller-manager-864dd78c4c-f4jns\" (UID: \"3828fcac-2770-4441-b718-5255990d2d2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:55.205739 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.205704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb492\" (UniqueName: \"kubernetes.io/projected/3828fcac-2770-4441-b718-5255990d2d2e-kube-api-access-zb492\") pod \"dns-operator-controller-manager-864dd78c4c-f4jns\" (UID: \"3828fcac-2770-4441-b718-5255990d2d2e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:55.285810 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.285724 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:55.436111 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.436070 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns"] Jul 06 19:31:55.438127 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:55.438068 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3828fcac_2770_4441_b718_5255990d2d2e.slice/crio-7751fe0502cbf8dd89a0a3ed3f418de0403b3edcc992700be8194afd4300c15f WatchSource:0}: Error finding container 7751fe0502cbf8dd89a0a3ed3f418de0403b3edcc992700be8194afd4300c15f: Status 404 returned error can't find the container with id 7751fe0502cbf8dd89a0a3ed3f418de0403b3edcc992700be8194afd4300c15f Jul 06 19:31:55.448728 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:55.448690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" event={"ID":"3828fcac-2770-4441-b718-5255990d2d2e","Type":"ContainerStarted","Data":"7751fe0502cbf8dd89a0a3ed3f418de0403b3edcc992700be8194afd4300c15f"} Jul 06 19:31:57.514477 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.513979 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z"] Jul 06 19:31:57.518437 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.518409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:31:57.521322 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.521297 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6nlbs\"" Jul 06 19:31:57.529360 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.529335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z"] Jul 06 19:31:57.617495 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.617451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgrt\" (UniqueName: \"kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt\") pod \"limitador-operator-controller-manager-859d7b78bd-gg25z\" (UID: \"1cfeafd9-0f92-4175-a5ab-177cad5e17ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:31:57.718929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.718887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgrt\" (UniqueName: \"kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt\") pod \"limitador-operator-controller-manager-859d7b78bd-gg25z\" (UID: \"1cfeafd9-0f92-4175-a5ab-177cad5e17ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:31:57.729816 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.729786 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgrt\" (UniqueName: \"kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt\") pod \"limitador-operator-controller-manager-859d7b78bd-gg25z\" (UID: \"1cfeafd9-0f92-4175-a5ab-177cad5e17ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:31:57.830925 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.830831 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:31:57.976067 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:57.976036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z"] Jul 06 19:31:57.977439 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:31:57.977410 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfeafd9_0f92_4175_a5ab_177cad5e17ee.slice/crio-ce5f472b21243a9826528ab6d24a76e9476e3b753ded900caafe23b72c3ed1bb WatchSource:0}: Error finding container ce5f472b21243a9826528ab6d24a76e9476e3b753ded900caafe23b72c3ed1bb: Status 404 returned error can't find the container with id ce5f472b21243a9826528ab6d24a76e9476e3b753ded900caafe23b72c3ed1bb Jul 06 19:31:58.471192 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:58.471153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" event={"ID":"3828fcac-2770-4441-b718-5255990d2d2e","Type":"ContainerStarted","Data":"2bc9af31cbca994f2eb77679415728fb584e740fd68799990a144f59a66e560b"} Jul 06 19:31:58.471400 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:58.471289 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:31:58.472746 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:58.472708 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" event={"ID":"1cfeafd9-0f92-4175-a5ab-177cad5e17ee","Type":"ContainerStarted","Data":"ce5f472b21243a9826528ab6d24a76e9476e3b753ded900caafe23b72c3ed1bb"} Jul 06 19:31:58.492083 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:31:58.492021 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" podStartSLOduration=2.351184015 podStartE2EDuration="4.491998338s" totalImagesPullingTime="2.140814323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:58.490527298 +0000 UTC m=+522.057057150" watchObservedRunningTime="2026-07-06 19:31:58.491998338 +0000 UTC m=+522.058528193" Jul 06 19:32:00.420054 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:00.420022 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:32:00.492540 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:00.492497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" event={"ID":"069dc6a9-91d1-4e24-ad2e-27673aeedda2","Type":"ContainerStarted","Data":"1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa"} Jul 06 19:32:00.492698 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:00.492582 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:00.515225 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:00.515174 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" podStartSLOduration=1.707466162 podStartE2EDuration="8.515156779s" totalImagesPullingTime="6.807690617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:00.513546367 +0000 UTC m=+524.080076219" watchObservedRunningTime="2026-07-06 19:32:00.515156779 +0000 UTC m=+524.081686631" Jul 06 19:32:01.499914 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:01.499875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" event={"ID":"1cfeafd9-0f92-4175-a5ab-177cad5e17ee","Type":"ContainerStarted","Data":"09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0"} Jul 06 19:32:01.500515 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:01.499942 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:01.520591 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:01.520537 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" podStartSLOduration=1.708959232 podStartE2EDuration="4.520521164s" totalImagesPullingTime="2.811561932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:01.51935274 +0000 UTC m=+525.085882593" watchObservedRunningTime="2026-07-06 19:32:01.520521164 +0000 UTC m=+525.087051017" Jul 06 19:32:02.612183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.612143 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6"] Jul 06 19:32:02.616031 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.616009 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.618726 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.618699 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vpt7f\"" Jul 06 19:32:02.618726 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.618713 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 19:32:02.618908 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.618857 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 19:32:02.625530 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.625507 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6"] Jul 06 19:32:02.765977 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.765936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.766200 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.766006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4szbz\" (UniqueName: \"kubernetes.io/projected/c6db47cc-938b-4a6b-86d6-c661f35aa559-kube-api-access-4szbz\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.766200 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.766033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6db47cc-938b-4a6b-86d6-c661f35aa559-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.867021 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.866934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4szbz\" (UniqueName: \"kubernetes.io/projected/c6db47cc-938b-4a6b-86d6-c661f35aa559-kube-api-access-4szbz\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.867021 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.866975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6db47cc-938b-4a6b-86d6-c661f35aa559-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.867245 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.867031 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.867245 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:02.867161 2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 19:32:02.867245 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:02.867215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert podName:c6db47cc-938b-4a6b-86d6-c661f35aa559 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:03.367199304 +0000 UTC m=+526.933729134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rvsk6" (UID: "c6db47cc-938b-4a6b-86d6-c661f35aa559") : secret "plugin-serving-cert" not found Jul 06 19:32:02.867709 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.867688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6db47cc-938b-4a6b-86d6-c661f35aa559-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:02.876810 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:02.876777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4szbz\" (UniqueName: \"kubernetes.io/projected/c6db47cc-938b-4a6b-86d6-c661f35aa559-kube-api-access-4szbz\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:03.372403 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:03.372362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:03.374878 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:03.374840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6db47cc-938b-4a6b-86d6-c661f35aa559-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rvsk6\" (UID: \"c6db47cc-938b-4a6b-86d6-c661f35aa559\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:03.525630 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:03.525582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" Jul 06 19:32:03.664643 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:03.664613 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6"] Jul 06 19:32:03.666746 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:32:03.666721 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6db47cc_938b_4a6b_86d6_c661f35aa559.slice/crio-9245a5ba62d979308aa15afa2122c31c144c82fe8bc15aa82b2592463ba5604b WatchSource:0}: Error finding container 9245a5ba62d979308aa15afa2122c31c144c82fe8bc15aa82b2592463ba5604b: Status 404 returned error can't find the container with id 9245a5ba62d979308aa15afa2122c31c144c82fe8bc15aa82b2592463ba5604b Jul 06 19:32:04.517330 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:04.517288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" event={"ID":"c6db47cc-938b-4a6b-86d6-c661f35aa559","Type":"ContainerStarted","Data":"9245a5ba62d979308aa15afa2122c31c144c82fe8bc15aa82b2592463ba5604b"} Jul 06 19:32:09.483273 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:09.483189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:32:11.502903 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:11.502872 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:12.508569 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:12.508537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:13.209235 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.209198 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x"] Jul 06 19:32:13.209518 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.209435 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" containerName="manager" containerID="cri-o://1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa" gracePeriod=2 Jul 06 19:32:13.212125 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.212070 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:13.212788 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.212760 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x"] Jul 06 19:32:13.222360 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.222329 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z"] Jul 06 19:32:13.222943 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.222543 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" containerName="manager" containerID="cri-o://09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0" gracePeriod=2 Jul 06 19:32:13.226609 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.226467 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:13.229686 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.229626 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:13.232363 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.232269 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z"] Jul 06 19:32:13.235295 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235258 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:13.235837 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235790 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" containerName="manager" Jul 06 19:32:13.235837 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235809 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" containerName="manager" Jul 06 19:32:13.235837 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235829 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" containerName="manager" Jul 06 19:32:13.235837 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235834 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" containerName="manager" Jul 06 19:32:13.236091 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235903 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" containerName="manager" Jul 06 19:32:13.236091 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.235917 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" containerName="manager" Jul 06 19:32:13.243593 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.243568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.248036 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.246216 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4"] Jul 06 19:32:13.248036 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.246501 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:13.250357 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.250329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:13.253758 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.253728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:13.259744 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.259714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6jc\" (UniqueName: \"kubernetes.io/projected/b6ec8aba-7ef1-425d-925c-c81dc0f9227e-kube-api-access-xl6jc\") pod \"limitador-operator-controller-manager-859d7b78bd-mfvm4\" (UID: \"b6ec8aba-7ef1-425d-925c-c81dc0f9227e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:13.259867 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.259769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.259867 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.259835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pqbx\" (UniqueName: \"kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.266635 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.266607 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4"] Jul 06 19:32:13.282751 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.282703 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:13.309990 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.309944 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:13.312578 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:13.312544 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:13.360652 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.360624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pqbx\" (UniqueName: \"kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.360804 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.360747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6jc\" (UniqueName: \"kubernetes.io/projected/b6ec8aba-7ef1-425d-925c-c81dc0f9227e-kube-api-access-xl6jc\") pod \"limitador-operator-controller-manager-859d7b78bd-mfvm4\" (UID: \"b6ec8aba-7ef1-425d-925c-c81dc0f9227e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:13.360804 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.360788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.361156 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.361136 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.378292 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.378253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pqbx\" (UniqueName: \"kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr9tn\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.379916 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.379887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6jc\" (UniqueName: \"kubernetes.io/projected/b6ec8aba-7ef1-425d-925c-c81dc0f9227e-kube-api-access-xl6jc\") pod \"limitador-operator-controller-manager-859d7b78bd-mfvm4\" (UID: \"b6ec8aba-7ef1-425d-925c-c81dc0f9227e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:13.652250 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.652218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:13.659633 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:13.659594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:25.914652 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.914245 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:25.916813 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:25.916775 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:25.932341 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.932316 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:25.936245 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:25.935854 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:25.939499 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:25.939187 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:25.940521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.940497 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:25.968005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.967976 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4"] Jul 06 19:32:25.976465 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.976437 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfgrt\" (UniqueName: \"kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt\") pod \"1cfeafd9-0f92-4175-a5ab-177cad5e17ee\" (UID: \"1cfeafd9-0f92-4175-a5ab-177cad5e17ee\") " Jul 06 19:32:25.976598 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.976544 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gjb6\" (UniqueName: \"kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6\") pod \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " Jul 06 19:32:25.976663 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.976595 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume\") pod \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\" (UID: \"069dc6a9-91d1-4e24-ad2e-27673aeedda2\") " Jul 06 19:32:25.976767 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:32:25.976443 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ec8aba_7ef1_425d_925c_c81dc0f9227e.slice/crio-8db44e5ed5e6dd41a27fae414455a26265caff755fb8ab68f07e3dcd55451aa3 WatchSource:0}: Error finding container 8db44e5ed5e6dd41a27fae414455a26265caff755fb8ab68f07e3dcd55451aa3: Status 404 returned error can't find the container with id 8db44e5ed5e6dd41a27fae414455a26265caff755fb8ab68f07e3dcd55451aa3 Jul 06 19:32:25.977263 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.977240 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "069dc6a9-91d1-4e24-ad2e-27673aeedda2" (UID: "069dc6a9-91d1-4e24-ad2e-27673aeedda2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:32:25.978827 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.978795 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt" (OuterVolumeSpecName: "kube-api-access-tfgrt") pod "1cfeafd9-0f92-4175-a5ab-177cad5e17ee" (UID: "1cfeafd9-0f92-4175-a5ab-177cad5e17ee"). InnerVolumeSpecName "kube-api-access-tfgrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:32:25.979057 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:25.979034 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6" (OuterVolumeSpecName: "kube-api-access-9gjb6") pod "069dc6a9-91d1-4e24-ad2e-27673aeedda2" (UID: "069dc6a9-91d1-4e24-ad2e-27673aeedda2"). InnerVolumeSpecName "kube-api-access-9gjb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:32:26.077905 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.077870 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfgrt\" (UniqueName: \"kubernetes.io/projected/1cfeafd9-0f92-4175-a5ab-177cad5e17ee-kube-api-access-tfgrt\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:32:26.077905 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.077901 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gjb6\" (UniqueName: \"kubernetes.io/projected/069dc6a9-91d1-4e24-ad2e-27673aeedda2-kube-api-access-9gjb6\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:32:26.077905 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.077910 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/069dc6a9-91d1-4e24-ad2e-27673aeedda2-extensions-socket-volume\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:32:26.656534 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.656497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" event={"ID":"b6ec8aba-7ef1-425d-925c-c81dc0f9227e","Type":"ContainerStarted","Data":"7c9bd5111db87282d2689333f847b8edcc5c5197ff2a10b4c722bd65c0c9b490"} Jul 06 19:32:26.656746 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.656552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" event={"ID":"b6ec8aba-7ef1-425d-925c-c81dc0f9227e","Type":"ContainerStarted","Data":"8db44e5ed5e6dd41a27fae414455a26265caff755fb8ab68f07e3dcd55451aa3"} Jul 06 19:32:26.656746 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.656618 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:26.658398 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.658366 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" event={"ID":"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93","Type":"ContainerStarted","Data":"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b"} Jul 06 19:32:26.658507 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.658418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" event={"ID":"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93","Type":"ContainerStarted","Data":"1ad5d8ca6714051053bb12a44d4822ecea4e9b18a9765befc3205daad332a15e"} Jul 06 19:32:26.658507 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.658446 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:26.659567 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.659527 2558 generic.go:356] "Generic (PLEG): container finished" podID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" containerID="1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa" exitCode=0 Jul 06 19:32:26.659675 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.659618 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:26.659675 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.659622 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:26.659675 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.659644 2558 scope.go:117] "RemoveContainer" containerID="1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa" Jul 06 19:32:26.661050 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.661024 2558 generic.go:356] "Generic (PLEG): container finished" podID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" containerID="09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0" exitCode=0 Jul 06 19:32:26.661181 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.661086 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:26.662745 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.662722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" event={"ID":"c6db47cc-938b-4a6b-86d6-c661f35aa559","Type":"ContainerStarted","Data":"cb8f5d383b77d4099bf68ac7482d2304cf0b709d1fbde9c98701b784965c64c9"} Jul 06 19:32:26.671828 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.671807 2558 scope.go:117] "RemoveContainer" containerID="1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa" Jul 06 19:32:26.672233 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.672211 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa\": container with ID starting with 1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa not found: ID does not exist" containerID="1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa" Jul 06 19:32:26.672310 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.672242 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa"} err="failed to get container status \"1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa\": rpc error: code = NotFound desc = could not find container \"1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa\": container with ID starting with 1f5ae93c04004f11af63c3635d097be91dade0d425fd541cd18efa3c3d752aaa not found: ID does not exist" Jul 06 19:32:26.672310 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.672261 2558 scope.go:117] "RemoveContainer" containerID="09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0" Jul 06 19:32:26.681686 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.681648 2558 scope.go:117] "RemoveContainer" containerID="09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0" Jul 06 19:32:26.682133 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.682089 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0\": container with ID starting with 09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0 not found: ID does not exist" containerID="09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0" Jul 06 19:32:26.682242 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.682142 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0"} err="failed to get container status \"09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0\": rpc error: code = NotFound desc = could not find container \"09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0\": container with ID starting with 09ab099609069184926598d8e0fc925542a67ae1c6f637b5fefa81f0d02a92f0 not found: ID does not exist" Jul 06 19:32:26.683050 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.683012 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" podStartSLOduration=13.682987554 podStartE2EDuration="13.682987554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:26.681363393 +0000 UTC m=+550.247893247" watchObservedRunningTime="2026-07-06 19:32:26.682987554 +0000 UTC m=+550.249517406" Jul 06 19:32:26.684054 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.684026 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:26.686688 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.686662 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:26.705188 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.705127 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rvsk6" podStartSLOduration=2.521542941 podStartE2EDuration="24.705111831s" totalImagesPullingTime="22.18356889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:26.703334669 +0000 UTC m=+550.269864522" watchObservedRunningTime="2026-07-06 19:32:26.705111831 +0000 UTC m=+550.271641675" Jul 06 19:32:26.705578 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.705547 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:26.726566 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.726510 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" podStartSLOduration=13.726492368 podStartE2EDuration="13.726492368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:26.726269662 +0000 UTC m=+550.292799515" watchObservedRunningTime="2026-07-06 19:32:26.726492368 +0000 UTC m=+550.293022220" Jul 06 19:32:26.965091 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.964992 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5c2x\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5c2x" Jul 06 19:32:26.966149 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.966127 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069dc6a9-91d1-4e24-ad2e-27673aeedda2" path="/var/lib/kubelet/pods/069dc6a9-91d1-4e24-ad2e-27673aeedda2/volumes" Jul 06 19:32:26.966475 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:26.966462 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" path="/var/lib/kubelet/pods/1cfeafd9-0f92-4175-a5ab-177cad5e17ee/volumes" Jul 06 19:32:26.967303 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:26.967279 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gg25z\" is forbidden: User \"system:node:ip-10-0-143-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-242.ec2.internal' and this object" podUID="1cfeafd9-0f92-4175-a5ab-177cad5e17ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gg25z" Jul 06 19:32:30.343440 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.343400 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:30.343820 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.343598 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" podUID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" containerName="manager" containerID="cri-o://14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b" gracePeriod=10 Jul 06 19:32:30.605330 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.605262 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:30.610926 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.610896 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:32:30.611320 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.611307 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" containerName="manager" Jul 06 19:32:30.611383 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.611322 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" containerName="manager" Jul 06 19:32:30.611417 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.611397 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" containerName="manager" Jul 06 19:32:30.615016 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.614994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.630086 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.630051 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:32:30.689762 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.689728 2558 generic.go:356] "Generic (PLEG): container finished" podID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" containerID="14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b" exitCode=0 Jul 06 19:32:30.689929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.689775 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" Jul 06 19:32:30.689929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.689816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" event={"ID":"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93","Type":"ContainerDied","Data":"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b"} Jul 06 19:32:30.689929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.689874 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn" event={"ID":"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93","Type":"ContainerDied","Data":"1ad5d8ca6714051053bb12a44d4822ecea4e9b18a9765befc3205daad332a15e"} Jul 06 19:32:30.689929 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.689902 2558 scope.go:117] "RemoveContainer" containerID="14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b" Jul 06 19:32:30.699286 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.699266 2558 scope.go:117] "RemoveContainer" containerID="14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b" Jul 06 19:32:30.699599 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:32:30.699577 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b\": container with ID starting with 14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b not found: ID does not exist" containerID="14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b" Jul 06 19:32:30.699647 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.699612 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b"} err="failed to get container status \"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b\": rpc error: code = NotFound desc = could not find container \"14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b\": container with ID starting with 14ad9ed294be73aa20a30126f6b1c5ddc7e1b2c3314855b011837a8068e1d21b not found: ID does not exist" Jul 06 19:32:30.716008 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.715973 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume\") pod \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " Jul 06 19:32:30.716198 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.716043 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pqbx\" (UniqueName: \"kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx\") pod \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\" (UID: \"2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93\") " Jul 06 19:32:30.716294 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.716270 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.716405 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.716383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnz4\" (UniqueName: \"kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.716480 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.716456 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" (UID: "2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:32:30.718213 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.718183 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx" (OuterVolumeSpecName: "kube-api-access-5pqbx") pod "2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" (UID: "2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93"). InnerVolumeSpecName "kube-api-access-5pqbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:32:30.817452 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.817412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnz4\" (UniqueName: \"kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.817654 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.817559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.817654 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.817597 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-extensions-socket-volume\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:32:30.817654 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.817608 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pqbx\" (UniqueName: \"kubernetes.io/projected/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93-kube-api-access-5pqbx\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:32:30.817920 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.817904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.835567 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.835537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnz4\" (UniqueName: \"kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4\") pod \"kuadrant-operator-controller-manager-86878c769f-qxqfw\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:30.925701 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:30.925657 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:31.013711 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.013671 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:31.019273 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.019238 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr9tn"] Jul 06 19:32:31.073964 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.073933 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:32:31.075581 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:32:31.075552 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88786d96_b9d7_4554_89d1_9123235fc257.slice/crio-58fc2798e194b05ee1a5c4f7c0d53b513e9586803cc6bc2988f0030ffcbb4cd3 WatchSource:0}: Error finding container 58fc2798e194b05ee1a5c4f7c0d53b513e9586803cc6bc2988f0030ffcbb4cd3: Status 404 returned error can't find the container with id 58fc2798e194b05ee1a5c4f7c0d53b513e9586803cc6bc2988f0030ffcbb4cd3 Jul 06 19:32:31.698819 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.698773 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerStarted","Data":"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f"} Jul 06 19:32:31.699233 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.698844 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:32:31.699233 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.698866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerStarted","Data":"58fc2798e194b05ee1a5c4f7c0d53b513e9586803cc6bc2988f0030ffcbb4cd3"} Jul 06 19:32:31.723246 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:31.723189 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" podStartSLOduration=1.7231708289999998 podStartE2EDuration="1.723170829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:31.720453027 +0000 UTC m=+555.286982881" watchObservedRunningTime="2026-07-06 19:32:31.723170829 +0000 UTC m=+555.289700682" Jul 06 19:32:32.965089 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:32.965056 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93" path="/var/lib/kubelet/pods/2f0e5bd3-944a-4e6c-b48d-2bf96b3d7f93/volumes" Jul 06 19:32:37.673866 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:37.673834 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:32:42.707280 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:32:42.707244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:33:00.036811 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.036770 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:33:00.060701 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.060660 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:33:00.060888 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.060769 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.063724 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.063699 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 19:33:00.071768 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.071741 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:33:00.186583 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.186543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10c0093a-5b40-453e-83fe-0a7113ce9f60-config-file\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.186785 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.186611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl9df\" (UniqueName: \"kubernetes.io/projected/10c0093a-5b40-453e-83fe-0a7113ce9f60-kube-api-access-kl9df\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.287940 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.287853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl9df\" (UniqueName: \"kubernetes.io/projected/10c0093a-5b40-453e-83fe-0a7113ce9f60-kube-api-access-kl9df\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.287940 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.287936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10c0093a-5b40-453e-83fe-0a7113ce9f60-config-file\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.288617 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.288595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10c0093a-5b40-453e-83fe-0a7113ce9f60-config-file\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.298749 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.298720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl9df\" (UniqueName: \"kubernetes.io/projected/10c0093a-5b40-453e-83fe-0a7113ce9f60-kube-api-access-kl9df\") pod \"limitador-limitador-54d6d988d5-5q9hz\" (UID: \"10c0093a-5b40-453e-83fe-0a7113ce9f60\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.372639 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.372603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:00.520091 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.520065 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:33:00.522460 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:33:00.522422 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c0093a_5b40_453e_83fe_0a7113ce9f60.slice/crio-1def078d1a6fdb7371df9d8947aa20c5c90caddea302c3d87c99a489e179429a WatchSource:0}: Error finding container 1def078d1a6fdb7371df9d8947aa20c5c90caddea302c3d87c99a489e179429a: Status 404 returned error can't find the container with id 1def078d1a6fdb7371df9d8947aa20c5c90caddea302c3d87c99a489e179429a Jul 06 19:33:00.868821 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:00.868776 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" event={"ID":"10c0093a-5b40-453e-83fe-0a7113ce9f60","Type":"ContainerStarted","Data":"1def078d1a6fdb7371df9d8947aa20c5c90caddea302c3d87c99a489e179429a"} Jul 06 19:33:03.890271 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:03.890233 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" event={"ID":"10c0093a-5b40-453e-83fe-0a7113ce9f60","Type":"ContainerStarted","Data":"f772e925f508b7ebdc0cff6e0b69141c0358c503603943e3c461a24598ef330a"} Jul 06 19:33:03.890856 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:03.890344 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:03.911525 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:03.911465 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" podStartSLOduration=1.4543872 podStartE2EDuration="3.91144748s" totalImagesPullingTime="2.45706028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:03.908956066 +0000 UTC m=+587.475485946" watchObservedRunningTime="2026-07-06 19:33:03.91144748 +0000 UTC m=+587.477977332" Jul 06 19:33:14.896976 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:14.896941 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5q9hz" Jul 06 19:33:16.900512 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:16.900477 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:33:16.901139 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:33:16.901109 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:34:16.111339 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:16.111297 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:34:37.041402 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:37.041367 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:34:57.133546 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.133509 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r"] Jul 06 19:34:57.137610 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.137578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.142140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.142110 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:34:57.142328 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.142155 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 19:34:57.142328 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.142165 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wxh4n\"" Jul 06 19:34:57.142328 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.142174 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:34:57.147675 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.147653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r"] Jul 06 19:34:57.226842 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.226798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.226842 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.226840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.227056 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.226894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.227056 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.226940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntc2m\" (UniqueName: \"kubernetes.io/projected/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-kube-api-access-ntc2m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.227056 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.226978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.227056 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.227004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327624 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327624 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntc2m\" (UniqueName: \"kubernetes.io/projected/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-kube-api-access-ntc2m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.327872 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.327778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.328139 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.328051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.328139 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.328081 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.328237 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.328215 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.330010 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.329989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.330368 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.330351 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.337262 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.337234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntc2m\" (UniqueName: \"kubernetes.io/projected/3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6-kube-api-access-ntc2m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb75r\" (UID: \"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.451376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.451255 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:34:57.601705 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.601671 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r"] Jul 06 19:34:57.603464 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:34:57.603440 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6e1c66_a632_4ae4_a7b4_ae26f8ef5df6.slice/crio-82196eb441cfc93681f0a09ff4386af221144b41029b35b062c9fba7565e1b24 WatchSource:0}: Error finding container 82196eb441cfc93681f0a09ff4386af221144b41029b35b062c9fba7565e1b24: Status 404 returned error can't find the container with id 82196eb441cfc93681f0a09ff4386af221144b41029b35b062c9fba7565e1b24 Jul 06 19:34:57.604783 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.604755 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:34:57.942320 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:57.942280 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:34:58.540625 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:58.540588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" event={"ID":"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6","Type":"ContainerStarted","Data":"82196eb441cfc93681f0a09ff4386af221144b41029b35b062c9fba7565e1b24"} Jul 06 19:34:59.548044 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:34:59.548009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" event={"ID":"3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6","Type":"ContainerStarted","Data":"85cbdc45d46b2bdb66d6c3de27596da989fda6cdca1cb08c54883fc12a8f3eb6"} Jul 06 19:35:03.845015 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:03.844956 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" podStartSLOduration=5.772933646 podStartE2EDuration="6.844938767s" totalImagesPullingTime="1.072005121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:59.569864968 +0000 UTC m=+703.136394821" watchObservedRunningTime="2026-07-06 19:35:03.844938767 +0000 UTC m=+707.411468620" Jul 06 19:35:03.845710 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:03.845690 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:35:07.452083 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:07.452037 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:35:07.452649 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:07.452133 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:35:07.465161 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:07.465129 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:35:07.607355 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:07.607322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb75r" Jul 06 19:35:11.845996 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:11.845909 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:35:24.332131 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:24.332081 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:35:28.922389 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:28.922350 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w"] Jul 06 19:35:28.927844 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:28.927817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:28.930626 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:28.930602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 19:35:28.939294 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:28.939267 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w"] Jul 06 19:35:29.021362 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75a9138-1f63-4a83-952a-88361d58a9cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.021362 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.021640 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnk2\" (UniqueName: \"kubernetes.io/projected/c75a9138-1f63-4a83-952a-88361d58a9cd-kube-api-access-tsnk2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.021640 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.021640 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.021640 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.021492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122701 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75a9138-1f63-4a83-952a-88361d58a9cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122701 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnk2\" (UniqueName: \"kubernetes.io/projected/c75a9138-1f63-4a83-952a-88361d58a9cd-kube-api-access-tsnk2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.122968 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.122813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.123297 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.123274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.123353 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.123293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.123389 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.123365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.125070 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.125050 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75a9138-1f63-4a83-952a-88361d58a9cd-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.125248 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.125231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75a9138-1f63-4a83-952a-88361d58a9cd-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.134570 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.134541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnk2\" (UniqueName: \"kubernetes.io/projected/c75a9138-1f63-4a83-952a-88361d58a9cd-kube-api-access-tsnk2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w\" (UID: \"c75a9138-1f63-4a83-952a-88361d58a9cd\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.239256 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.239169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:29.392198 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.392160 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w"] Jul 06 19:35:29.393618 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:35:29.393589 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75a9138_1f63_4a83_952a_88361d58a9cd.slice/crio-c5736e3f8d18fccf2278df7e78cea68565416b59fde017882dbc2d0a48e239eb WatchSource:0}: Error finding container c5736e3f8d18fccf2278df7e78cea68565416b59fde017882dbc2d0a48e239eb: Status 404 returned error can't find the container with id c5736e3f8d18fccf2278df7e78cea68565416b59fde017882dbc2d0a48e239eb Jul 06 19:35:29.721925 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.721875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" event={"ID":"c75a9138-1f63-4a83-952a-88361d58a9cd","Type":"ContainerStarted","Data":"e806b86230e12001b3e340cc86782afddf3a233c11b24fccfaf95ce9f26551a7"} Jul 06 19:35:29.722135 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.721936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" event={"ID":"c75a9138-1f63-4a83-952a-88361d58a9cd","Type":"ContainerStarted","Data":"c5736e3f8d18fccf2278df7e78cea68565416b59fde017882dbc2d0a48e239eb"} Jul 06 19:35:29.751286 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:29.751230 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" podStartSLOduration=1.549974342 podStartE2EDuration="1.751212808s" totalImagesPullingTime="201.238466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:29.750387387 +0000 UTC m=+733.316917237" watchObservedRunningTime="2026-07-06 19:35:29.751212808 +0000 UTC m=+733.317742661" Jul 06 19:35:31.046930 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:31.046897 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:35:39.239989 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:39.239948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:39.239989 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:39.239999 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:39.252835 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:39.252810 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:35:39.800791 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:35:39.800754 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w" Jul 06 19:36:53.334517 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:36:53.334471 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:37:03.743197 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:03.743162 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:37:13.737140 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:13.737085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:37:26.123583 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.123537 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" podUID="f3b8181b-fcb0-4df3-97c3-0ddfeaa40047" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.41:8081/healthz\": dial tcp 10.133.0.41:8081: connect: connection refused" Jul 06 19:37:26.409641 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.409606 2558 generic.go:356] "Generic (PLEG): container finished" podID="88786d96-b9d7-4554-89d1-9123235fc257" containerID="4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f" exitCode=0 Jul 06 19:37:26.409852 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.409689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerDied","Data":"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f"} Jul 06 19:37:26.410088 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.410072 2558 scope.go:117] "RemoveContainer" containerID="4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f" Jul 06 19:37:26.411412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.411394 2558 generic.go:356] "Generic (PLEG): container finished" podID="b6ec8aba-7ef1-425d-925c-c81dc0f9227e" containerID="7c9bd5111db87282d2689333f847b8edcc5c5197ff2a10b4c722bd65c0c9b490" exitCode=1 Jul 06 19:37:26.411501 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.411464 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" event={"ID":"b6ec8aba-7ef1-425d-925c-c81dc0f9227e","Type":"ContainerDied","Data":"7c9bd5111db87282d2689333f847b8edcc5c5197ff2a10b4c722bd65c0c9b490"} Jul 06 19:37:26.411781 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.411767 2558 scope.go:117] "RemoveContainer" containerID="7c9bd5111db87282d2689333f847b8edcc5c5197ff2a10b4c722bd65c0c9b490" Jul 06 19:37:26.413298 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.413278 2558 generic.go:356] "Generic (PLEG): container finished" podID="f3b8181b-fcb0-4df3-97c3-0ddfeaa40047" containerID="0115732be0c27f2cdd5f3717030686f890c264c46e99c53f9623cf53b0f0534f" exitCode=1 Jul 06 19:37:26.413365 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.413340 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" event={"ID":"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047","Type":"ContainerDied","Data":"0115732be0c27f2cdd5f3717030686f890c264c46e99c53f9623cf53b0f0534f"} Jul 06 19:37:26.413624 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:26.413608 2558 scope.go:117] "RemoveContainer" containerID="0115732be0c27f2cdd5f3717030686f890c264c46e99c53f9623cf53b0f0534f" Jul 06 19:37:27.422698 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.422657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerStarted","Data":"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65"} Jul 06 19:37:27.423220 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.422889 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:37:27.424642 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.424613 2558 generic.go:356] "Generic (PLEG): container finished" podID="248f4f21-7e9f-41ca-9b49-ff35e76e093b" containerID="a82895dddff5704f891de13c73966389533154efc13910f45ff4ea1d295141d0" exitCode=1 Jul 06 19:37:27.424760 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.424676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" event={"ID":"248f4f21-7e9f-41ca-9b49-ff35e76e093b","Type":"ContainerDied","Data":"a82895dddff5704f891de13c73966389533154efc13910f45ff4ea1d295141d0"} Jul 06 19:37:27.425031 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.425009 2558 scope.go:117] "RemoveContainer" containerID="a82895dddff5704f891de13c73966389533154efc13910f45ff4ea1d295141d0" Jul 06 19:37:27.427189 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.427157 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" event={"ID":"b6ec8aba-7ef1-425d-925c-c81dc0f9227e","Type":"ContainerStarted","Data":"a8b47170f7482f46eaadbe77eff59a6bc5d1729583e6a197210617ed3cdb662a"} Jul 06 19:37:27.427408 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.427391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:37:27.429336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.429311 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" event={"ID":"f3b8181b-fcb0-4df3-97c3-0ddfeaa40047","Type":"ContainerStarted","Data":"941cccb90228afb5c4ac43d16d5f22c5eed0d16d4c3f668870c7257bbc1198c5"} Jul 06 19:37:27.429654 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.429631 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:37:27.431737 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.431679 2558 generic.go:356] "Generic (PLEG): container finished" podID="3828fcac-2770-4441-b718-5255990d2d2e" containerID="2bc9af31cbca994f2eb77679415728fb584e740fd68799990a144f59a66e560b" exitCode=1 Jul 06 19:37:27.431858 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.431756 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" event={"ID":"3828fcac-2770-4441-b718-5255990d2d2e","Type":"ContainerDied","Data":"2bc9af31cbca994f2eb77679415728fb584e740fd68799990a144f59a66e560b"} Jul 06 19:37:27.432047 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.432032 2558 scope.go:117] "RemoveContainer" containerID="2bc9af31cbca994f2eb77679415728fb584e740fd68799990a144f59a66e560b" Jul 06 19:37:27.434378 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.434338 2558 generic.go:356] "Generic (PLEG): container finished" podID="586eeb1e-ba1d-4495-96fd-b69d12bbf7f0" containerID="bf955cf01646ea07291773c342d794b1d5328035c3510c264e77e14a7b896f3d" exitCode=1 Jul 06 19:37:27.434541 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.434383 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" event={"ID":"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0","Type":"ContainerDied","Data":"bf955cf01646ea07291773c342d794b1d5328035c3510c264e77e14a7b896f3d"} Jul 06 19:37:27.434746 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.434718 2558 scope.go:117] "RemoveContainer" containerID="bf955cf01646ea07291773c342d794b1d5328035c3510c264e77e14a7b896f3d" Jul 06 19:37:27.437438 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:27.437420 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 19:37:28.442703 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.442667 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" event={"ID":"586eeb1e-ba1d-4495-96fd-b69d12bbf7f0","Type":"ContainerStarted","Data":"fa8f1b65bb5c3216ba8476f5babe190e3aae5ac4692070d04a45c736c1e5627a"} Jul 06 19:37:28.443177 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.442870 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:37:28.444644 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.444613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" event={"ID":"248f4f21-7e9f-41ca-9b49-ff35e76e093b","Type":"ContainerStarted","Data":"1c5d5e6b87692acbf72b151669cd9beef423cef9573e8b45689bec865aaf93a1"} Jul 06 19:37:28.444830 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.444814 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:37:28.446434 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.446414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" event={"ID":"3828fcac-2770-4441-b718-5255990d2d2e","Type":"ContainerStarted","Data":"6c83cb6a4fe6cd97606d71a24957f31a1d29a47b2b8de7f3b286ec3656105f6c"} Jul 06 19:37:28.446719 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:28.446706 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:37:29.452553 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:29.452516 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:37:38.449217 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:38.449186 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mfvm4" Jul 06 19:37:38.449629 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:38.449256 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:37:38.449629 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:38.449380 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wcdqj" Jul 06 19:37:40.459967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:40.459930 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4jns" Jul 06 19:37:51.454754 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:51.454714 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:37:59.454506 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:59.454473 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4skz6" Jul 06 19:37:59.457562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:37:59.457537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zhpf5" Jul 06 19:38:02.221694 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:02.221658 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:38:10.928005 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:10.927920 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:38:16.937707 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:16.937678 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:38:16.942799 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:16.942773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:38:44.032764 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:44.032729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:38:51.233203 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:38:51.233161 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:39:23.732562 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:39:23.732526 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:39:33.432271 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:39:33.432228 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:39:42.433809 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:39:42.433727 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:39:51.928183 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:39:51.928139 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:40:02.032053 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:40:02.032007 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:40:11.621438 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:40:11.621399 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:40:22.730583 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:40:22.730538 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:40:32.332812 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:40:32.332772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:40:55.028449 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:40:55.028404 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:41:06.830659 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:41:06.830618 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:41:30.335645 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:41:30.335601 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:41:40.545109 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:41:40.545067 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:41:55.235914 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:41:55.235873 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:42:06.939834 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:42:06.939782 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:42:16.058202 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:42:16.058161 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:42:25.734254 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:42:25.734216 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:42:34.034061 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:42:34.034019 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:43:00.521381 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:00.521342 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:43:00.521988 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:00.521668 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" containerID="cri-o://c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65" gracePeriod=10 Jul 06 19:43:03.781659 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:03.781629 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:43:03.937923 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:03.937871 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqnz4\" (UniqueName: \"kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4\") pod \"88786d96-b9d7-4554-89d1-9123235fc257\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " Jul 06 19:43:03.938156 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:03.937965 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume\") pod \"88786d96-b9d7-4554-89d1-9123235fc257\" (UID: \"88786d96-b9d7-4554-89d1-9123235fc257\") " Jul 06 19:43:03.938380 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:03.938353 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88786d96-b9d7-4554-89d1-9123235fc257" (UID: "88786d96-b9d7-4554-89d1-9123235fc257"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:43:03.940071 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:03.940050 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4" (OuterVolumeSpecName: "kube-api-access-zqnz4") pod "88786d96-b9d7-4554-89d1-9123235fc257" (UID: "88786d96-b9d7-4554-89d1-9123235fc257"). InnerVolumeSpecName "kube-api-access-zqnz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:43:04.039395 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.039340 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqnz4\" (UniqueName: \"kubernetes.io/projected/88786d96-b9d7-4554-89d1-9123235fc257-kube-api-access-zqnz4\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:43:04.039395 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.039386 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88786d96-b9d7-4554-89d1-9123235fc257-extensions-socket-volume\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 19:43:04.426725 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.426695 2558 generic.go:356] "Generic (PLEG): container finished" podID="88786d96-b9d7-4554-89d1-9123235fc257" containerID="c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65" exitCode=0 Jul 06 19:43:04.426918 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.426740 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" Jul 06 19:43:04.426918 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.426781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerDied","Data":"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65"} Jul 06 19:43:04.426918 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.426836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw" event={"ID":"88786d96-b9d7-4554-89d1-9123235fc257","Type":"ContainerDied","Data":"58fc2798e194b05ee1a5c4f7c0d53b513e9586803cc6bc2988f0030ffcbb4cd3"} Jul 06 19:43:04.426918 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.426859 2558 scope.go:117] "RemoveContainer" containerID="c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65" Jul 06 19:43:04.437443 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.437424 2558 scope.go:117] "RemoveContainer" containerID="4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f" Jul 06 19:43:04.446423 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.446405 2558 scope.go:117] "RemoveContainer" containerID="c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65" Jul 06 19:43:04.446704 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:43:04.446683 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65\": container with ID starting with c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65 not found: ID does not exist" containerID="c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65" Jul 06 19:43:04.446756 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.446713 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65"} err="failed to get container status \"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65\": rpc error: code = NotFound desc = could not find container \"c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65\": container with ID starting with c04ef82900a23a0a4a7b0f61358237a4d9da82044cd25ca660b41b9b63e64d65 not found: ID does not exist" Jul 06 19:43:04.446756 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.446731 2558 scope.go:117] "RemoveContainer" containerID="4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f" Jul 06 19:43:04.446989 ip-10-0-143-242 kubenswrapper[2558]: E0706 19:43:04.446970 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f\": container with ID starting with 4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f not found: ID does not exist" containerID="4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f" Jul 06 19:43:04.447033 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.446996 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f"} err="failed to get container status \"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f\": rpc error: code = NotFound desc = could not find container \"4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f\": container with ID starting with 4fb60f13a76fcb9117cff154cadfbe2ad7df752142f06482b39dc31c0b7a7c8f not found: ID does not exist" Jul 06 19:43:04.451481 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.451448 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:43:04.456357 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.456333 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qxqfw"] Jul 06 19:43:04.971049 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:04.971015 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88786d96-b9d7-4554-89d1-9123235fc257" path="/var/lib/kubelet/pods/88786d96-b9d7-4554-89d1-9123235fc257/volumes" Jul 06 19:43:16.986239 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:16.986206 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:43:16.990470 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:43:16.990436 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:44:01.717900 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.717863 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428"] Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718302 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718317 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718336 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718342 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718412 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.720376 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.718421 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="88786d96-b9d7-4554-89d1-9123235fc257" containerName="manager" Jul 06 19:44:01.721686 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.721667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.724931 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.724897 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ft7g9\"" Jul 06 19:44:01.735844 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.735817 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428"] Jul 06 19:44:01.844382 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.844340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g5sm\" (UniqueName: \"kubernetes.io/projected/7a80aaef-2946-436e-9d03-6bf9430848f6-kube-api-access-8g5sm\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.844564 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.844470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a80aaef-2946-436e-9d03-6bf9430848f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.945789 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.945747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a80aaef-2946-436e-9d03-6bf9430848f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.945916 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.945841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g5sm\" (UniqueName: \"kubernetes.io/projected/7a80aaef-2946-436e-9d03-6bf9430848f6-kube-api-access-8g5sm\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.946203 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.946186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a80aaef-2946-436e-9d03-6bf9430848f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:01.959051 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:01.959013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g5sm\" (UniqueName: \"kubernetes.io/projected/7a80aaef-2946-436e-9d03-6bf9430848f6-kube-api-access-8g5sm\") pod \"kuadrant-operator-controller-manager-86878c769f-wg428\" (UID: \"7a80aaef-2946-436e-9d03-6bf9430848f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:02.032412 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.032319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:02.185664 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.185632 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428"] Jul 06 19:44:02.187610 ip-10-0-143-242 kubenswrapper[2558]: W0706 19:44:02.187563 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a80aaef_2946_436e_9d03_6bf9430848f6.slice/crio-7246d32228b7f37e4899b545c3860021f210acf0017a92cf1260d0b50a14b875 WatchSource:0}: Error finding container 7246d32228b7f37e4899b545c3860021f210acf0017a92cf1260d0b50a14b875: Status 404 returned error can't find the container with id 7246d32228b7f37e4899b545c3860021f210acf0017a92cf1260d0b50a14b875 Jul 06 19:44:02.762110 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.762068 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" event={"ID":"7a80aaef-2946-436e-9d03-6bf9430848f6","Type":"ContainerStarted","Data":"7580f5bb89fe05f25af4caf5ef2b75392ccf3af6fa8ecfe55e31abcb3e739ef4"} Jul 06 19:44:02.762543 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.762141 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" event={"ID":"7a80aaef-2946-436e-9d03-6bf9430848f6","Type":"ContainerStarted","Data":"7246d32228b7f37e4899b545c3860021f210acf0017a92cf1260d0b50a14b875"} Jul 06 19:44:02.762543 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.762180 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:02.791639 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:02.791576 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" podStartSLOduration=1.791561352 podStartE2EDuration="1.791561352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:44:02.790359965 +0000 UTC m=+1246.356889819" watchObservedRunningTime="2026-07-06 19:44:02.791561352 +0000 UTC m=+1246.358091204" Jul 06 19:44:13.770547 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:13.770512 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wg428" Jul 06 19:44:23.725563 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:23.725521 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:44:35.129899 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:35.129860 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:44:44.831767 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:44.831725 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:44:55.922046 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:44:55.922004 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:07.232380 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:07.232340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:19.031433 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:19.031394 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:26.843512 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:26.843474 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:37.153932 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:37.153895 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:48.735028 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:48.734941 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:45:57.536521 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:45:57.536482 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:46:07.933942 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:46:07.933907 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:46:30.135284 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:46:30.135244 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:46:38.831080 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:46:38.831043 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:46:48.255025 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:46:48.254988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:00.630568 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:00.630527 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:14.532070 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:14.531984 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:25.629419 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:25.629379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:34.531548 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:34.531505 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:44.337950 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:44.337918 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:47:53.534233 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:47:53.534182 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:48:03.125854 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:03.125811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:48:17.028718 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:17.028681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:48:17.034625 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:17.034603 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:48:30.935265 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:30.935227 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:48:40.730361 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:40.730272 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:48:50.033967 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:48:50.033929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:49:03.526612 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:49:03.526563 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:49:12.729255 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:49:12.729217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:49:23.640797 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:49:23.640759 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:49:35.635721 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:49:35.635680 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:49:54.637660 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:49:54.637621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:02.134428 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:02.134387 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:12.732301 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:12.732217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:22.444218 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:22.444179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:33.966267 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:33.966221 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:44.744288 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:44.744251 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:53.436704 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:53.436665 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:50:59.941336 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:50:59.941286 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:51:10.259257 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:51:10.259214 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:51:19.559918 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:51:19.559880 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:51:27.951535 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:51:27.951488 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:52:53.531563 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:52:53.531524 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:53:01.031447 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:01.031402 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:53:08.732549 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:08.732512 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:53:17.065059 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:17.065030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:53:17.073976 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:17.073948 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:53:32.731386 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:32.731347 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:53:39.737004 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:53:39.736968 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:54:15.440040 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:54:15.439999 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:54:23.944112 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:54:23.944061 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:54:48.151375 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:54:48.151281 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:55:01.938357 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:55:01.938316 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:55:42.324990 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:55:42.324950 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:55:51.441219 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:55:51.441180 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:56:02.239791 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:56:02.239746 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:56:53.531885 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:56:53.531844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:57:04.745129 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:57:04.744910 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:57:28.156319 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:57:28.156283 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:58:17.110844 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:58:17.110815 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:58:17.124383 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:58:17.124353 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 19:58:35.051958 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:58:35.051922 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:59:00.729407 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:59:00.729365 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:59:44.132052 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:59:44.132012 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 19:59:57.240037 ip-10-0-143-242 kubenswrapper[2558]: I0706 19:59:57.239994 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:00:00.131811 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.131770 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-dkm6t"] Jul 06 20:00:00.135596 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.135567 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:00.138814 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.138785 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jplkb\"" Jul 06 20:00:00.139048 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.138804 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn"] Jul 06 20:00:00.144169 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.144144 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:00.146559 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.146534 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-dkm6t"] Jul 06 20:00:00.153135 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.153091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn"] Jul 06 20:00:00.200343 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.200305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpr96\" (UniqueName: \"kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96\") pod \"maas-api-key-cleanup-29722800-dkm6t\" (UID: \"22581a6c-b771-4e2f-abd9-b56f77a8c0d4\") " pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:00.200523 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.200369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgl5t\" (UniqueName: \"kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t\") pod \"maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn\" (UID: \"f2927871-8758-425a-969c-fadf2e45d8b0\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:00.301682 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.301644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpr96\" (UniqueName: \"kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96\") pod \"maas-api-key-cleanup-29722800-dkm6t\" (UID: \"22581a6c-b771-4e2f-abd9-b56f77a8c0d4\") " pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:00.301860 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.301719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgl5t\" (UniqueName: \"kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t\") pod \"maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn\" (UID: \"f2927871-8758-425a-969c-fadf2e45d8b0\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:00.311727 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.311689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpr96\" (UniqueName: \"kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96\") pod \"maas-api-key-cleanup-29722800-dkm6t\" (UID: \"22581a6c-b771-4e2f-abd9-b56f77a8c0d4\") " pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:00.312087 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.312061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgl5t\" (UniqueName: \"kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t\") pod \"maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn\" (UID: \"f2927871-8758-425a-969c-fadf2e45d8b0\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:00.452430 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.452337 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:00.460150 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.460091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:00.622735 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.622711 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-dkm6t"] Jul 06 20:00:00.625862 ip-10-0-143-242 kubenswrapper[2558]: W0706 20:00:00.625801 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22581a6c_b771_4e2f_abd9_b56f77a8c0d4.slice/crio-5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f WatchSource:0}: Error finding container 5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f: Status 404 returned error can't find the container with id 5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f Jul 06 20:00:00.628014 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.627995 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:00:00.653377 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:00.653348 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn"] Jul 06 20:00:00.654836 ip-10-0-143-242 kubenswrapper[2558]: W0706 20:00:00.654810 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2927871_8758_425a_969c_fadf2e45d8b0.slice/crio-862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6 WatchSource:0}: Error finding container 862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6: Status 404 returned error can't find the container with id 862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6 Jul 06 20:00:01.413040 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:01.412998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" event={"ID":"f2927871-8758-425a-969c-fadf2e45d8b0","Type":"ContainerStarted","Data":"862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6"} Jul 06 20:00:01.414629 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:01.414602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" event={"ID":"22581a6c-b771-4e2f-abd9-b56f77a8c0d4","Type":"ContainerStarted","Data":"5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f"} Jul 06 20:00:06.448815 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:06.448777 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" event={"ID":"f2927871-8758-425a-969c-fadf2e45d8b0","Type":"ContainerStarted","Data":"d3d0c8a8a811a865db8ce10929a8e11afa56e28d7523a84967c4ce6e783cc002"} Jul 06 20:00:06.450318 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:06.450290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" event={"ID":"22581a6c-b771-4e2f-abd9-b56f77a8c0d4","Type":"ContainerStarted","Data":"497c2c9f2e41164095a7ba1aaa3231ae4662872e7ac2b208512c45282c24dfb9"} Jul 06 20:00:06.470272 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:06.470214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" podStartSLOduration=1.420269592 podStartE2EDuration="6.470185812s" totalImagesPullingTime="5.04991622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:06.466267446 +0000 UTC m=+2210.032797324" watchObservedRunningTime="2026-07-06 20:00:06.470185812 +0000 UTC m=+2210.036715667" Jul 06 20:00:06.483745 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:06.483694 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" podStartSLOduration=1.069953471 podStartE2EDuration="6.483681002s" totalImagesPullingTime="5.413727531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:06.482655021 +0000 UTC m=+2210.049184884" watchObservedRunningTime="2026-07-06 20:00:06.483681002 +0000 UTC m=+2210.050210893" Jul 06 20:00:07.457741 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:07.457707 2558 generic.go:356] "Generic (PLEG): container finished" podID="f2927871-8758-425a-969c-fadf2e45d8b0" containerID="d3d0c8a8a811a865db8ce10929a8e11afa56e28d7523a84967c4ce6e783cc002" exitCode=0 Jul 06 20:00:07.458221 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:07.457796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" event={"ID":"f2927871-8758-425a-969c-fadf2e45d8b0","Type":"ContainerDied","Data":"d3d0c8a8a811a865db8ce10929a8e11afa56e28d7523a84967c4ce6e783cc002"} Jul 06 20:00:07.459430 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:07.459403 2558 generic.go:356] "Generic (PLEG): container finished" podID="22581a6c-b771-4e2f-abd9-b56f77a8c0d4" containerID="497c2c9f2e41164095a7ba1aaa3231ae4662872e7ac2b208512c45282c24dfb9" exitCode=0 Jul 06 20:00:07.459553 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:07.459465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" event={"ID":"22581a6c-b771-4e2f-abd9-b56f77a8c0d4","Type":"ContainerDied","Data":"497c2c9f2e41164095a7ba1aaa3231ae4662872e7ac2b208512c45282c24dfb9"} Jul 06 20:00:07.839214 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:07.839121 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:00:08.618303 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.618279 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:08.638978 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.638947 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:08.777200 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.777082 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgl5t\" (UniqueName: \"kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t\") pod \"f2927871-8758-425a-969c-fadf2e45d8b0\" (UID: \"f2927871-8758-425a-969c-fadf2e45d8b0\") " Jul 06 20:00:08.777200 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.777169 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpr96\" (UniqueName: \"kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96\") pod \"22581a6c-b771-4e2f-abd9-b56f77a8c0d4\" (UID: \"22581a6c-b771-4e2f-abd9-b56f77a8c0d4\") " Jul 06 20:00:08.779424 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.779392 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96" (OuterVolumeSpecName: "kube-api-access-vpr96") pod "22581a6c-b771-4e2f-abd9-b56f77a8c0d4" (UID: "22581a6c-b771-4e2f-abd9-b56f77a8c0d4"). InnerVolumeSpecName "kube-api-access-vpr96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:08.779555 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.779538 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t" (OuterVolumeSpecName: "kube-api-access-fgl5t") pod "f2927871-8758-425a-969c-fadf2e45d8b0" (UID: "f2927871-8758-425a-969c-fadf2e45d8b0"). InnerVolumeSpecName "kube-api-access-fgl5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:08.878557 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.878515 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpr96\" (UniqueName: \"kubernetes.io/projected/22581a6c-b771-4e2f-abd9-b56f77a8c0d4-kube-api-access-vpr96\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 20:00:08.878557 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:08.878552 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgl5t\" (UniqueName: \"kubernetes.io/projected/f2927871-8758-425a-969c-fadf2e45d8b0-kube-api-access-fgl5t\") on node \"ip-10-0-143-242.ec2.internal\" DevicePath \"\"" Jul 06 20:00:09.473948 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.473914 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" Jul 06 20:00:09.474165 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.473915 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn" event={"ID":"f2927871-8758-425a-969c-fadf2e45d8b0","Type":"ContainerDied","Data":"862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6"} Jul 06 20:00:09.474165 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.474048 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="862b55b31a287603dc9d08bd06059facd54821ff9cbfaa0082ba731f36cc5bc6" Jul 06 20:00:09.475459 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.475438 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" Jul 06 20:00:09.475459 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.475445 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-dkm6t" event={"ID":"22581a6c-b771-4e2f-abd9-b56f77a8c0d4","Type":"ContainerDied","Data":"5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f"} Jul 06 20:00:09.475630 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:09.475500 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5be22d93aeab75b1aaf142e008e58bfd6a6de35b252a32144f14ca24db32643f" Jul 06 20:00:13.410528 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:13.410486 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn"] Jul 06 20:00:13.413297 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:13.413270 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-a-c0c2c4-29722800-tjmpn"] Jul 06 20:00:14.965728 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:14.965692 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2927871-8758-425a-969c-fadf2e45d8b0" path="/var/lib/kubelet/pods/f2927871-8758-425a-969c-fadf2e45d8b0/volumes" Jul 06 20:00:22.841674 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:22.841634 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:00:36.437883 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:36.437845 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:00:48.333761 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:00:48.333660 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:01:04.635548 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:01:04.635512 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:01:32.638497 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:01:32.638463 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:01:48.943115 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:01:48.943067 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:02:07.250369 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:02:07.250320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:02:20.341631 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:02:20.341589 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:02:37.836078 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:02:37.836040 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:02:53.632334 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:02:53.632292 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:03:10.931224 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:03:10.931182 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:03:17.153813 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:03:17.153778 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 20:03:17.164606 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:03:17.164572 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 20:03:39.443959 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:03:39.443866 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:03:54.039566 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:03:54.039519 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:04:08.844348 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:04:08.844311 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:04:28.944747 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:04:28.944696 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:04:47.354807 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:04:47.354761 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:05:02.555988 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:05:02.555933 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:05:20.672999 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:05:20.672895 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:05:46.434726 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:05:46.434691 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:05:59.736135 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:05:59.736083 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:06:14.155082 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:06:14.155044 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:06:26.054056 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:06:26.054015 2558 scope.go:117] "RemoveContainer" containerID="d3d0c8a8a811a865db8ce10929a8e11afa56e28d7523a84967c4ce6e783cc002" Jul 06 20:06:29.535670 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:06:29.535626 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:07:08.742774 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:08.742734 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5q9hz"] Jul 06 20:07:19.195503 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:19.195470 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zhpf5_586eeb1e-ba1d-4495-96fd-b69d12bbf7f0/manager/1.log" Jul 06 20:07:19.334762 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:19.334732 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4skz6_248f4f21-7e9f-41ca-9b49-ff35e76e093b/manager/1.log" Jul 06 20:07:19.714275 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:19.714243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-dkm6t_22581a6c-b771-4e2f-abd9-b56f77a8c0d4/cleanup/0.log" Jul 06 20:07:19.978382 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:19.978302 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jw7gw_35269ddd-65b4-4058-911d-737a1b97f342/server/0.log" Jul 06 20:07:20.234852 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:20.234746 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb8c7879-j6r4n_0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8/copy-manifests/0.log" Jul 06 20:07:20.256670 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:20.256624 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb8c7879-j6r4n_0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8/manager/0.log" Jul 06 20:07:21.480614 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.480575 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/util/0.log" Jul 06 20:07:21.491856 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.491821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/pull/0.log" Jul 06 20:07:21.502020 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.501993 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/extract/0.log" Jul 06 20:07:21.625914 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.625885 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/util/0.log" Jul 06 20:07:21.636456 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.636424 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/pull/0.log" Jul 06 20:07:21.650004 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.649982 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/extract/0.log" Jul 06 20:07:21.788072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.787989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/util/0.log" Jul 06 20:07:21.805538 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.805506 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/pull/0.log" Jul 06 20:07:21.822915 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.822886 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/extract/0.log" Jul 06 20:07:21.952133 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.952093 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/util/0.log" Jul 06 20:07:21.962331 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.962304 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/pull/0.log" Jul 06 20:07:21.973293 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:21.973271 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/extract/0.log" Jul 06 20:07:22.222849 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.222819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wcdqj_f3b8181b-fcb0-4df3-97c3-0ddfeaa40047/manager/1.log" Jul 06 20:07:22.341149 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.341114 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4jns_3828fcac-2770-4441-b718-5255990d2d2e/manager/1.log" Jul 06 20:07:22.467010 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.466982 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rvsk6_c6db47cc-938b-4a6b-86d6-c661f35aa559/kuadrant-console-plugin/0.log" Jul 06 20:07:22.621005 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.620978 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8p49d_d0d8d918-5760-4c77-a180-7a3f937a3fa1/registry-server/0.log" Jul 06 20:07:22.766826 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.766784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wg428_7a80aaef-2946-436e-9d03-6bf9430848f6/manager/0.log" Jul 06 20:07:22.893273 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:22.893194 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5q9hz_10c0093a-5b40-453e-83fe-0a7113ce9f60/limitador/0.log" Jul 06 20:07:23.029394 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:23.029366 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mfvm4_b6ec8aba-7ef1-425d-925c-c81dc0f9227e/manager/1.log" Jul 06 20:07:23.776364 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:23.776339 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54bf5b454b-zlhm7_a9725e90-85f0-4a3a-b803-bc48935e4eae/kube-auth-proxy/0.log" Jul 06 20:07:24.788726 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:24.788693 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nb75r_3e6e1c66-a632-4ae4-a7b4-ae26f8ef5df6/main/0.log" Jul 06 20:07:25.260266 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:25.260233 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-zb75w_c75a9138-1f63-4a83-952a-88361d58a9cd/main/0.log" Jul 06 20:07:32.371887 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:32.371853 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w4lgr_a74285f6-c63b-4576-9daf-fadb5c2788fb/global-pull-secret-syncer/0.log" Jul 06 20:07:32.488712 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:32.488678 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9gtdh_525a9ded-c749-4af3-a6f1-4c1c80e6490d/konnectivity-agent/0.log" Jul 06 20:07:32.650464 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:32.650373 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-242.ec2.internal_fd6b21424b4cc58df7f0f7a37abe13f5/haproxy/0.log" Jul 06 20:07:36.907863 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:36.907822 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/extract/0.log" Jul 06 20:07:36.942001 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:36.941970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/util/0.log" Jul 06 20:07:36.965863 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:36.965836 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tz6jg_c4a8e309-ce16-4419-bedd-290935746853/pull/0.log" Jul 06 20:07:36.998795 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:36.998754 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/extract/0.log" Jul 06 20:07:37.038294 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.038266 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/util/0.log" Jul 06 20:07:37.065531 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.065495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04cwnz_bcfcf368-5af2-4204-a4b6-000561c45ef3/pull/0.log" Jul 06 20:07:37.127332 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.127298 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/extract/0.log" Jul 06 20:07:37.151911 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.151884 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/util/0.log" Jul 06 20:07:37.187695 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.187616 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73djk22_816ccab4-7d0b-42e3-9aa8-ef05815a3214/pull/0.log" Jul 06 20:07:37.229717 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.229685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/extract/0.log" Jul 06 20:07:37.254054 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.254029 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/util/0.log" Jul 06 20:07:37.279086 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.279056 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jbz9p_b0efae6d-d392-465e-88a2-f144f50d5efe/pull/0.log" Jul 06 20:07:37.662431 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.662398 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wcdqj_f3b8181b-fcb0-4df3-97c3-0ddfeaa40047/manager/1.log" Jul 06 20:07:37.667203 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.667176 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wcdqj_f3b8181b-fcb0-4df3-97c3-0ddfeaa40047/manager/0.log" Jul 06 20:07:37.710450 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.710413 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4jns_3828fcac-2770-4441-b718-5255990d2d2e/manager/0.log" Jul 06 20:07:37.710624 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.710491 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4jns_3828fcac-2770-4441-b718-5255990d2d2e/manager/1.log" Jul 06 20:07:37.737023 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.736998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rvsk6_c6db47cc-938b-4a6b-86d6-c661f35aa559/kuadrant-console-plugin/0.log" Jul 06 20:07:37.795046 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.795013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8p49d_d0d8d918-5760-4c77-a180-7a3f937a3fa1/registry-server/0.log" Jul 06 20:07:37.979257 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:37.979164 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wg428_7a80aaef-2946-436e-9d03-6bf9430848f6/manager/0.log" Jul 06 20:07:38.006823 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:38.006789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5q9hz_10c0093a-5b40-453e-83fe-0a7113ce9f60/limitador/0.log" Jul 06 20:07:38.056563 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:38.056526 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mfvm4_b6ec8aba-7ef1-425d-925c-c81dc0f9227e/manager/0.log" Jul 06 20:07:38.112973 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:38.112940 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mfvm4_b6ec8aba-7ef1-425d-925c-c81dc0f9227e/manager/1.log" Jul 06 20:07:40.170381 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.170344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dc754d9f9-whn5p_39286453-88b3-47b4-a0da-c9ffb261cd3b/metrics-server/0.log" Jul 06 20:07:40.276630 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.276604 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clg29_d27e264b-79dc-4c24-95c8-f6dc2fc1ac67/node-exporter/0.log" Jul 06 20:07:40.317175 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.317149 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clg29_d27e264b-79dc-4c24-95c8-f6dc2fc1ac67/kube-rbac-proxy/0.log" Jul 06 20:07:40.357628 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.357603 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-clg29_d27e264b-79dc-4c24-95c8-f6dc2fc1ac67/init-textfile/0.log" Jul 06 20:07:40.668644 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.668613 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-pp6wm_0d0db986-5660-4e2d-8132-29df1205f611/kube-rbac-proxy-main/0.log" Jul 06 20:07:40.702274 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.702243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-pp6wm_0d0db986-5660-4e2d-8132-29df1205f611/kube-rbac-proxy-self/0.log" Jul 06 20:07:40.742780 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:40.742747 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-pp6wm_0d0db986-5660-4e2d-8132-29df1205f611/openshift-state-metrics/0.log" Jul 06 20:07:41.113408 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.113324 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-zwsnd_0c545a82-3b51-46e0-9383-99294291dcf7/prometheus-operator-admission-webhook/0.log" Jul 06 20:07:41.154161 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.154133 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fc6d7d4-5bxwb_d4a444ce-d8aa-48f8-99e4-e3fc4c238110/telemeter-client/0.log" Jul 06 20:07:41.185148 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.185116 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fc6d7d4-5bxwb_d4a444ce-d8aa-48f8-99e4-e3fc4c238110/reload/0.log" Jul 06 20:07:41.222420 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.222397 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8fc6d7d4-5bxwb_d4a444ce-d8aa-48f8-99e4-e3fc4c238110/kube-rbac-proxy/0.log" Jul 06 20:07:41.844473 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844435 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9"] Jul 06 20:07:41.844863 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844851 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2927871-8758-425a-969c-fadf2e45d8b0" containerName="cleanup" Jul 06 20:07:41.844910 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844866 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2927871-8758-425a-969c-fadf2e45d8b0" containerName="cleanup" Jul 06 20:07:41.844910 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844894 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22581a6c-b771-4e2f-abd9-b56f77a8c0d4" containerName="cleanup" Jul 06 20:07:41.844910 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844900 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22581a6c-b771-4e2f-abd9-b56f77a8c0d4" containerName="cleanup" Jul 06 20:07:41.845008 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844982 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22581a6c-b771-4e2f-abd9-b56f77a8c0d4" containerName="cleanup" Jul 06 20:07:41.845008 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.844992 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2927871-8758-425a-969c-fadf2e45d8b0" containerName="cleanup" Jul 06 20:07:41.849600 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.849569 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:41.853397 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.853372 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7tz4\"/\"kube-root-ca.crt\"" Jul 06 20:07:41.854486 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.854460 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7tz4\"/\"openshift-service-ca.crt\"" Jul 06 20:07:41.854666 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.854653 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7tz4\"/\"default-dockercfg-ph479\"" Jul 06 20:07:41.860331 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.860305 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9"] Jul 06 20:07:41.901363 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.901327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-podres\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:41.901363 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.901366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5mpp\" (UniqueName: \"kubernetes.io/projected/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-kube-api-access-x5mpp\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:41.901595 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.901456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-sys\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:41.901595 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.901491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-proc\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:41.901595 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:41.901569 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-lib-modules\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.002830 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-podres\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.002830 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5mpp\" (UniqueName: \"kubernetes.io/projected/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-kube-api-access-x5mpp\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-sys\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-proc\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-lib-modules\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-sys\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.002964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-podres\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.003023 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-proc\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.003072 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.003053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-lib-modules\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.013381 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.013354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5mpp\" (UniqueName: \"kubernetes.io/projected/1f9a0fdc-4c9a-441d-a324-89f35cabfc9d-kube-api-access-x5mpp\") pod \"perf-node-gather-daemonset-wbtx9\" (UID: \"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d\") " pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.162240 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.162193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:42.310293 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:42.310259 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9"] Jul 06 20:07:42.311506 ip-10-0-143-242 kubenswrapper[2558]: W0706 20:07:42.311479 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f9a0fdc_4c9a_441d_a324_89f35cabfc9d.slice/crio-a04259dd8d8f12ba196ea5c1d1dfc9a948e92e84c9011b0ce06334cfb74321c6 WatchSource:0}: Error finding container a04259dd8d8f12ba196ea5c1d1dfc9a948e92e84c9011b0ce06334cfb74321c6: Status 404 returned error can't find the container with id a04259dd8d8f12ba196ea5c1d1dfc9a948e92e84c9011b0ce06334cfb74321c6 Jul 06 20:07:43.217054 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.217014 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" event={"ID":"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d","Type":"ContainerStarted","Data":"7296227e44d47fc4178a4a2d8120f96d796240d0ad684d8ce0f159d4da3cbfa8"} Jul 06 20:07:43.217268 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.217082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" event={"ID":"1f9a0fdc-4c9a-441d-a324-89f35cabfc9d","Type":"ContainerStarted","Data":"a04259dd8d8f12ba196ea5c1d1dfc9a948e92e84c9011b0ce06334cfb74321c6"} Jul 06 20:07:43.217268 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.217226 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:43.238627 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.238568 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" podStartSLOduration=2.238553006 podStartE2EDuration="2.238553006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:43.235732278 +0000 UTC m=+2666.802262132" watchObservedRunningTime="2026-07-06 20:07:43.238553006 +0000 UTC m=+2666.805082905" Jul 06 20:07:43.423278 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.423247 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/1.log" Jul 06 20:07:43.431280 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:43.431250 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-ph8hj_bc1bbfc5-6261-4d4f-9ded-9ac75f074a56/console-operator/2.log" Jul 06 20:07:44.052696 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:44.052667 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-bw8z8_aaa7b8f6-e959-4ca7-a50f-aa44a07bd147/download-server/0.log" Jul 06 20:07:46.077050 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:46.077021 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pngvz_5b156647-348c-4719-96b3-74d206523ddf/dns/0.log" Jul 06 20:07:46.102016 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:46.101989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pngvz_5b156647-348c-4719-96b3-74d206523ddf/kube-rbac-proxy/0.log" Jul 06 20:07:46.195213 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:46.195181 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vcnb6_dc354b56-0837-4b6a-9b8a-cef809dded26/dns-node-resolver/0.log" Jul 06 20:07:46.815722 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:46.815689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f66654587-5vwn2_d8c7c5df-2c1c-4664-843f-f48095376af8/registry/0.log" Jul 06 20:07:46.890448 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:46.890407 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-677sr_a0773a41-2e3f-4be6-afe2-f044553267d5/node-ca/0.log" Jul 06 20:07:48.343482 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:48.343452 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54bf5b454b-zlhm7_a9725e90-85f0-4a3a-b803-bc48935e4eae/kube-auth-proxy/0.log" Jul 06 20:07:49.234303 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:49.234271 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7tz4/perf-node-gather-daemonset-wbtx9" Jul 06 20:07:49.587602 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:49.587501 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgn64_3d70f9b0-79d4-406c-9979-cab3a95f357a/serve-healthcheck-canary/0.log" Jul 06 20:07:50.217112 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:50.217060 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vscg7_648cbf48-438f-4721-9adf-3526105fc007/insights-operator/0.log" Jul 06 20:07:50.219756 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:50.219728 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vscg7_648cbf48-438f-4721-9adf-3526105fc007/insights-operator/1.log" Jul 06 20:07:50.350057 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:50.350028 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjsmr_1feabb15-7b20-4f91-994e-f8060d8f9544/kube-rbac-proxy/0.log" Jul 06 20:07:50.390225 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:50.390190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjsmr_1feabb15-7b20-4f91-994e-f8060d8f9544/exporter/0.log" Jul 06 20:07:50.425731 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:50.425701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jjsmr_1feabb15-7b20-4f91-994e-f8060d8f9544/extractor/0.log" Jul 06 20:07:52.411594 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:52.411561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54bf5b454b-zlhm7_a9725e90-85f0-4a3a-b803-bc48935e4eae/kube-auth-proxy/0.log" Jul 06 20:07:53.156831 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.156798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zhpf5_586eeb1e-ba1d-4495-96fd-b69d12bbf7f0/manager/1.log" Jul 06 20:07:53.157023 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.156845 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zhpf5_586eeb1e-ba1d-4495-96fd-b69d12bbf7f0/manager/0.log" Jul 06 20:07:53.207037 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.207002 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4skz6_248f4f21-7e9f-41ca-9b49-ff35e76e093b/manager/0.log" Jul 06 20:07:53.384588 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.384551 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4skz6_248f4f21-7e9f-41ca-9b49-ff35e76e093b/manager/1.log" Jul 06 20:07:53.501750 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.501715 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-dkm6t_22581a6c-b771-4e2f-abd9-b56f77a8c0d4/cleanup/0.log" Jul 06 20:07:53.712761 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.712728 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jw7gw_35269ddd-65b4-4058-911d-737a1b97f342/server/0.log" Jul 06 20:07:53.922379 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:53.922342 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb8c7879-j6r4n_0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8/manager/0.log" Jul 06 20:07:54.073036 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:54.072999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb8c7879-j6r4n_0e4aaf91-cefa-4042-8f68-1c3ac69ed4c8/copy-manifests/0.log" Jul 06 20:07:54.078435 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:54.078408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54bf5b454b-zlhm7_a9725e90-85f0-4a3a-b803-bc48935e4eae/kube-auth-proxy/0.log" Jul 06 20:07:55.702290 ip-10-0-143-242 kubenswrapper[2558]: I0706 20:07:55.702259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rzf4v_d246dc80-9e3d-4bbc-9f68-90310a82b1f3/openshift-lws-operator/0.log"