Jul 02 13:59:09.686627 ip-10-0-132-214 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 13:59:09.686643 ip-10-0-132-214 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 13:59:09.686653 ip-10-0-132-214 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 13:59:09.686995 ip-10-0-132-214 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 13:59:19.935644 ip-10-0-132-214 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 13:59:19.935663 ip-10-0-132-214 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 42cf87f3d585455282523c65675425d1 -- Jul 02 14:01:15.016361 ip-10-0-132-214 systemd[1]: Starting Kubernetes Kubelet... Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.399794 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403361 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403373 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403377 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403380 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403383 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403386 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403389 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.453755 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403391 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403394 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403397 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403400 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403402 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403408 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403412 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403416 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403419 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403421 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403424 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403427 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403429 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403432 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403435 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403438 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403440 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403443 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403447 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.457001 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403451 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403454 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403457 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403460 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403463 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403465 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403468 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403470 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403473 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403475 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403478 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403481 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403484 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403486 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403489 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403492 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403495 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403498 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403501 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403504 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.460953 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403506 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403509 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403511 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403514 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403516 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403518 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403520 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403523 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403525 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403528 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403531 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403534 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403536 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403539 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403541 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403544 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403546 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403549 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403551 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403554 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.464009 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403557 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403560 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403563 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403566 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403569 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403571 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403573 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403576 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403579 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403581 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403584 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403587 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403589 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403592 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403595 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403597 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403600 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403602 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403605 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403609 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.467954 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403612 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403614 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403617 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403619 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403621 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403624 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403628 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403631 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403634 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403637 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403640 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403642 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.403646 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405789 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405796 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405799 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405804 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405808 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405811 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.470923 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405815 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405818 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405820 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405823 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405825 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405828 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405831 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405833 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405836 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405838 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405841 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405843 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405846 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405848 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405851 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405853 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405856 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405860 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405863 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405866 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.475113 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405869 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405872 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405875 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405878 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405881 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405883 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405885 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405888 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405890 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405893 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405897 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405899 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405902 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405905 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405907 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405910 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405912 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405915 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405917 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405920 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.478064 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405922 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405925 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405927 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405930 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405932 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405935 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405938 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405941 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405943 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405946 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405948 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405951 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405953 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405956 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405958 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405961 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405963 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405966 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405969 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405973 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.481950 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405977 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405980 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405984 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405987 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405990 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405993 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405996 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.405998 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406001 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406003 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406007 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406009 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406012 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406014 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406017 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406019 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406022 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406024 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406027 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406029 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.484886 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406031 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406034 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406036 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406039 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406041 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406044 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406047 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406050 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406054 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406057 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406059 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406062 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406066 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406463 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406468 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406472 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406474 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406478 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406480 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.489032 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406483 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406486 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406488 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406491 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406493 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406496 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406499 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406501 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406504 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406507 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406510 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406513 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406515 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406518 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406520 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406523 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406525 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406528 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406530 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406533 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.492007 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406536 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406539 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406542 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406544 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406547 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406549 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406552 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406555 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406558 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406561 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406563 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406567 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406570 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406572 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406575 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406578 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406580 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406583 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406588 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.495631 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406591 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406597 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406599 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406602 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406604 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406607 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406610 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406613 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406615 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406618 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406621 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406624 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406626 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406630 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406633 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406639 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406641 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406644 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406648 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.498938 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406651 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.498861 ip-10-0-132-214 systemd[1]: Started Kubernetes Kubelet. Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406653 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406656 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406659 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406661 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406664 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406666 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406669 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406672 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406674 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406677 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406680 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406684 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406687 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406689 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406692 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406695 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406699 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406701 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.506741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406704 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406707 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406710 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406712 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406715 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406717 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406720 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406723 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406725 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406732 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406734 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406737 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406739 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406742 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.406745 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406814 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406821 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406828 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406833 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406837 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406840 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 14:01:15.511655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406845 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406849 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406852 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406855 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406858 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406862 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406865 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406868 2565 flags.go:64] FLAG: --cgroup-root="" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406871 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406876 2565 flags.go:64] FLAG: --client-ca-file="" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406879 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406882 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406886 2565 flags.go:64] FLAG: --cluster-domain="" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406889 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406892 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406896 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406900 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406903 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406906 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406910 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406914 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406918 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406921 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406924 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 14:01:15.515995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406927 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406930 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406935 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406938 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406940 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406944 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406947 2565 flags.go:64] FLAG: --enable-server="true" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406950 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406954 2565 flags.go:64] FLAG: --event-burst="100" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406957 2565 flags.go:64] FLAG: --event-qps="50" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406960 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406963 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406966 2565 flags.go:64] FLAG: --eviction-hard="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406970 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406973 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406976 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406979 2565 flags.go:64] FLAG: --eviction-soft="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406983 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406986 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406989 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406991 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406994 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.406997 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407000 2565 flags.go:64] FLAG: --feature-gates="" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407004 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 14:01:15.520175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407007 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407010 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407013 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407017 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407020 2565 flags.go:64] FLAG: --help="false" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407023 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407027 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407030 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407033 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407036 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407040 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407043 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407045 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407049 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407052 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407055 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407058 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407061 2565 flags.go:64] FLAG: --kube-reserved="" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407064 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407067 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407070 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407072 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407091 2565 flags.go:64] FLAG: --lock-file="" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407094 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 14:01:15.526166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407098 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407101 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407107 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407110 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407113 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407115 2565 flags.go:64] FLAG: --logging-format="text" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407118 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407122 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407125 2565 flags.go:64] FLAG: --manifest-url="" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407127 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407132 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407136 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407140 2565 flags.go:64] FLAG: --max-pods="110" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407143 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407146 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407149 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407153 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407156 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407159 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407161 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407169 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407172 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407175 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 14:01:15.706936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407178 2565 flags.go:64] FLAG: --pod-cidr="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407181 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407186 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407189 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407192 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407195 2565 flags.go:64] FLAG: --port="10250" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407198 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407201 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0225e94908019f3a8" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407204 2565 flags.go:64] FLAG: --qos-reserved="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407207 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407212 2565 flags.go:64] FLAG: --register-node="true" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407215 2565 flags.go:64] FLAG: --register-with-taints="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407219 2565 flags.go:64] FLAG: --registry-burst="10" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407222 2565 flags.go:64] FLAG: --registry-qps="5" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407225 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407227 2565 flags.go:64] FLAG: --reserved-memory="" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407234 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407237 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407240 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407243 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407247 2565 flags.go:64] FLAG: --runonce="false" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407249 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407252 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407255 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407258 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 14:01:15.729540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407261 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407264 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407267 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407270 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407273 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407276 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407279 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407282 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407285 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407288 2565 flags.go:64] FLAG: --system-cgroups="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407291 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407296 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407299 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407302 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407306 2565 flags.go:64] FLAG: --tls-min-version="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407309 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407312 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407316 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407319 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407322 2565 flags.go:64] FLAG: --v="2" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407326 2565 flags.go:64] FLAG: --version="false" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407330 2565 flags.go:64] FLAG: --vmodule="" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407333 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.407337 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407452 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.741095 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407456 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407458 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407462 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407465 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407467 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407470 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407472 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407475 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407478 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407480 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407483 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407485 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407488 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407490 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407494 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407498 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407501 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407504 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407506 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407509 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.742290 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407511 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407513 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407516 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407518 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407522 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407525 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407527 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407533 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407536 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407538 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407541 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407543 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407546 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407550 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407552 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407555 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407557 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407560 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407563 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.743124 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407565 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407568 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407570 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407573 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407575 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407578 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407580 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407583 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407586 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407588 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407591 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407593 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407596 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407598 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407601 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407603 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407606 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407609 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407611 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407614 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.743911 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407616 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407619 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407621 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407624 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407626 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407629 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407634 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407638 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407641 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407644 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407647 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407649 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407652 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407655 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407658 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407660 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407664 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407667 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407670 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.744727 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407673 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407676 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407679 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407681 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407685 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407687 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407690 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407692 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407695 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407699 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407702 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407704 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407706 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407709 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407711 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407714 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407717 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407720 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.745558 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.407722 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.408244 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.423475 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.423491 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.424130 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.424138 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424199 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424204 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424207 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424210 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424215 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424220 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424223 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424226 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.746423 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424228 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424231 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424234 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424237 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424240 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424243 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424245 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424248 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424251 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424253 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424260 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424262 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424265 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424267 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424270 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424273 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424275 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424278 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424280 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.747253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424285 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424289 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424291 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424294 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424296 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424299 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424303 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424306 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424309 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424312 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424314 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424318 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424320 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424323 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424326 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424328 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424331 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424333 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424336 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.748065 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424338 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424341 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424343 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424346 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424352 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424354 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424357 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424360 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424362 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424365 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424368 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424370 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424373 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424377 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424379 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424382 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424384 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424387 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424390 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424393 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.748919 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424395 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424398 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424400 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424403 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424405 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424408 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424410 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424413 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424415 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424418 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424421 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424423 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424426 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424429 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424432 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424435 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424438 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424440 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424443 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424446 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.749770 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424448 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424452 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424455 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424458 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424461 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424466 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424469 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424472 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424475 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424477 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424480 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424483 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424485 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.424490 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424609 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:01:15.750585 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424615 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424618 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424621 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424624 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424626 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424629 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424632 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424635 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424637 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424640 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424642 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424646 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424649 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424653 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424658 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424661 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424663 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424666 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424668 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424671 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:01:15.750996 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424674 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424676 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424680 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424682 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424685 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424688 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424690 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424693 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424696 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424698 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424701 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424703 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424706 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424709 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424711 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424714 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424716 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424719 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424722 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424724 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:01:15.751837 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424726 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424729 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424731 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424734 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424737 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424740 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424744 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424747 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424749 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424752 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424754 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424757 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424760 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424764 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424768 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424772 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424775 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424778 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:01:15.752651 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424781 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424784 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424786 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424789 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424792 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424794 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424797 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424799 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424802 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424805 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424807 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424810 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424812 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424815 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424817 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424820 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424822 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424825 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424827 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424830 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:01:15.753484 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424835 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424837 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424840 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424842 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424844 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424847 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424850 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424852 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424856 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424859 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424862 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424864 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424867 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424870 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424872 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424875 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424877 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424880 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424882 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:01:15.754719 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:15.424884 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.424889 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.425017 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.426973 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.428252 2565 server.go:1019] "Starting client certificate rotation" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.428352 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.428379 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.430563 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.433664 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.457232 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.458101 2565 log.go:25] "Validated CRI v1 runtime API" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.460137 2565 log.go:25] "Validated CRI v1 image API" Jul 02 14:01:15.755528 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.461497 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 14:01:15.755926 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.466574 2565 fs.go:135] Filesystem UUIDs: map[5ca8d8fb-7e5e-4151-9cc6-80d6450aa56a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d3e8ae9e-3ee0-4c9b-83d2-6dc88cabd3ce:/dev/nvme0n1p4] Jul 02 14:01:15.755926 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.466596 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.471360 2565 manager.go:216] Machine: {Timestamp:2026-07-02 14:01:15.470013438 +0000 UTC m=+0.343998613 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104126 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cdb6b13cb7e95ee5a39f63d85af84 SystemUUID:ec2cdb6b-13cb-7e95-ee5a-39f63d85af84 BootID:42cf87f3-d585-4552-8252-3c65675425d1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:ae:05:bf:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:ae:05:bf:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:c2:b0:49:4d:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.471458 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.471534 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.475732 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.475767 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.476477 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fndhc" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.477594 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.477605 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.477613 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.478958 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.480351 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.483859 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fndhc" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484380 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484482 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484506 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484516 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 14:01:15.859673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484531 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484540 2565 kubelet.go:398] "Adding apiserver pod source" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484549 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484845 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.484859 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.489125 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.492928 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.492956 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493642 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493654 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493660 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493666 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493677 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493686 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493696 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493702 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493708 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493714 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493722 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.493727 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.494385 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.494392 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.495863 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.497939 2565 server.go:1268] "Started kubelet" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.498036 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.498027 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.498571 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.499575 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.504569 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.504929 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.505571 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.506973 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-214.ec2.internal" not found Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.510528 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.510882 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.511651 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-214.ec2.internal\" not found" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512149 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512168 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512172 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512304 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512311 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512563 2565 factory.go:153] Registering CRI-O factory Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512574 2565 factory.go:223] Registration of the crio container factory successfully Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512614 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512621 2565 factory.go:55] Registering systemd factory Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512626 2565 factory.go:223] Registration of the systemd container factory successfully Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512643 2565 factory.go:103] Registering Raw factory Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.512652 2565 manager.go:1196] Started watching for new ooms in manager Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.516660 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.516995 2565 manager.go:349] Starting recovery of all containers Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.519048 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-214.ec2.internal\" not found" node="ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.527463 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-214.ec2.internal" not found Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.541588 2565 manager.go:354] Recovery completed Jul 02 14:01:15.860486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.545895 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.547847 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.547883 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.547901 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.548465 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.548474 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.548494 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.548495 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.549309 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.549343 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.549352 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.550653 2565 policy_none.go:49] "None policy: Start" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.550667 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.550677 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.552544 2565 policy_none.go:47] "Start" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.579275 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.580494 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.580553 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.580579 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.580618 2565 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.582678 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.589713 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-214.ec2.internal" not found Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.590651 2565 manager.go:337] "Starting Device Plugin manager" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.590679 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.590688 2565 server.go:87] "Starting device plugin registration server" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.590939 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.590949 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.591046 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.591136 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.591145 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.591558 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.591602 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-214.ec2.internal\" not found" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.681588 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal"] Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.681670 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.682835 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.682864 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.682885 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685160 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685273 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685303 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685873 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685896 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685909 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685927 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685942 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.872850 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.685956 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.687943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.687962 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.688584 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.688612 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.688629 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.691122 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.691866 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.691894 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.691908 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.691935 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.698759 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:15.698774 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-214.ec2.internal\": node \"ip-10-0-132-214.ec2.internal\" not found" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.712731 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.713474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.713496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.713515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a5c3d13bf76270246373f4c49b89cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"4a5c3d13bf76270246373f4c49b89cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.721659 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:15.874532 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:15.726256 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723085 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723123 2565 apiserver.go:52] "Watching apiserver" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723147 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723516 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a5c3d13bf76270246373f4c49b89cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"4a5c3d13bf76270246373f4c49b89cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723241 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:56:16 +0000 UTC" deadline="2028-02-15 05:55:11.312039742 +0000 UTC" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723566 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14223h53m54.588477469s" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723227 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e296f619fb6a1a3c00846ef68feadb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" (UID: \"6e296f619fb6a1a3c00846ef68feadb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a5c3d13bf76270246373f4c49b89cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" (UID: \"4a5c3d13bf76270246373f4c49b89cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.723226 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.723750 2565 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.724964 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.726738 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.729698 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.730464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.745167 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.745204 2565 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-214.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.746453 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.746793 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph","openshift-cluster-node-tuning-operator/tuned-gqjnp","openshift-multus/multus-tm89x","openshift-network-operator/iptables-alerter-mdbzm","kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal","openshift-dns/node-resolver-bjt68","openshift-image-registry/node-ca-d7zt7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal","openshift-multus/multus-additional-cni-plugins-jhdrr","openshift-multus/network-metrics-daemon-fmt8p","openshift-network-diagnostics/network-check-target-mmpqd","openshift-ovn-kubernetes/ovnkube-node-jq8d2","kube-system/global-pull-secret-syncer-7pllm","kube-system/konnectivity-agent-zs6cn"] Jul 02 14:01:16.759575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.749289 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.750517 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.751494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.751667 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.751902 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.752026 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.752065 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pkpxs\"" Jul 02 14:01:16.761328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.753621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763520 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763568 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qgm8k\"" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763722 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.763929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.763833 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.764940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.764418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.764940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.764538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 14:01:16.764940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.764809 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 14:01:16.764940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.764907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hn65z\"" Jul 02 14:01:16.766204 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.765903 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.766204 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.765962 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lpvbg\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.766189 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.766632 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.766671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.766775 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.766901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.766924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brx4g\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767063 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767097 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767289 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8njqf\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767295 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.767285 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.769272 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vj842" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.769407 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2txrd\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.769907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.769987 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.772602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.774745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.777252 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.777651 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.778903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5g8x6\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.778914 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779022 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779125 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779150 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779798 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zp8nt\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.779964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.780149 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vj842" Jul 02 14:01:16.888004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.813726 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-var-lib-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-env-overrides\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdxg2\" (UniqueName: \"kubernetes.io/projected/d47d1c82-5a69-4246-96d9-739b14e54c86-kube-api-access-gdxg2\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-etc-kubernetes\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384acbff-ca16-40f3-812d-d92f6b03faad-host-slash\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f238319d-82a3-424e-9201-cf2461feecde-hosts-file\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxbj\" (UniqueName: \"kubernetes.io/projected/c0b666d5-ecdb-442a-adf9-d5befbfa0723-kube-api-access-4mxbj\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-systemd-units\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-socket-dir-parent\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-hostroot\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-konnectivity-ca\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-cni-binary-copy\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-kubelet\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5539e66f-0564-48fc-8ba2-0cf8cc902e64-serviceca\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:16.889779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6xll\" (UniqueName: \"kubernetes.io/projected/5539e66f-0564-48fc-8ba2-0cf8cc902e64-kube-api-access-d6xll\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-sys-fs\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-lib-modules\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-var-lib-kubelet\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cnibin\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-agent-certs\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp7ps\" (UniqueName: \"kubernetes.io/projected/6e836b1b-2c68-4520-a64c-13c5e29b5a25-kube-api-access-kp7ps\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-system-cni-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-slash\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-netd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-bin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f238319d-82a3-424e-9201-cf2461feecde-tmp-dir\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-node-log\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.893769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-os-release\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824668 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5n6\" (UniqueName: \"kubernetes.io/projected/f238319d-82a3-424e-9201-cf2461feecde-kube-api-access-gp5n6\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-dbus\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysconfig\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-run\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-kubelet\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-systemd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-registration-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b2l2\" (UniqueName: \"kubernetes.io/projected/cca1a771-d579-467d-b236-2cdfa9307931-kube-api-access-5b2l2\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-tuned\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-etc-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-ovn\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-config\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d47d1c82-5a69-4246-96d9-739b14e54c86-ovn-node-metrics-cert\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.894677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-netns\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-multus\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-cnibin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-system-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.824987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-k8s-cni-cncf-io\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-daemon-config\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5xq\" (UniqueName: \"kubernetes.io/projected/c8c5c911-3593-4661-8b0a-51ad4ed58856-kube-api-access-fs5xq\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pl5t\" (UniqueName: \"kubernetes.io/projected/384acbff-ca16-40f3-812d-d92f6b03faad-kube-api-access-9pl5t\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-device-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-kubernetes\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-systemd\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-multus-certs\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/384acbff-ca16-40f3-812d-d92f6b03faad-iptables-alerter-script\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfsj8\" (UniqueName: \"kubernetes.io/projected/b9994a49-bec0-41c3-9b04-9f7873308707-kube-api-access-kfsj8\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-modprobe-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.897831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-sys\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-tmp\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-script-lib\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-os-release\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-kubelet-config\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-conf\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-host\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-netns\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5539e66f-0564-48fc-8ba2-0cf8cc902e64-host\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-log-socket\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-conf-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-bin\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:16.898720 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:16.903608 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:16.903608 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-socket-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:16.903608 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.825527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-script-lib\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-os-release\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-kubelet-config\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-conf\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-host\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-netns\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5539e66f-0564-48fc-8ba2-0cf8cc902e64-host\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-log-socket\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-conf-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-bin\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:17.029789 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-socket-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.925989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-var-lib-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-env-overrides\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdxg2\" (UniqueName: \"kubernetes.io/projected/d47d1c82-5a69-4246-96d9-739b14e54c86-kube-api-access-gdxg2\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-etc-kubernetes\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384acbff-ca16-40f3-812d-d92f6b03faad-host-slash\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f238319d-82a3-424e-9201-cf2461feecde-hosts-file\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxbj\" (UniqueName: \"kubernetes.io/projected/c0b666d5-ecdb-442a-adf9-d5befbfa0723-kube-api-access-4mxbj\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-systemd-units\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-socket-dir-parent\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-hostroot\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-konnectivity-ca\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-cni-binary-copy\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-kubelet\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5539e66f-0564-48fc-8ba2-0cf8cc902e64-serviceca\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.033752 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6xll\" (UniqueName: \"kubernetes.io/projected/5539e66f-0564-48fc-8ba2-0cf8cc902e64-kube-api-access-d6xll\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-sys-fs\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-lib-modules\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-var-lib-kubelet\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cnibin\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-agent-certs\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp7ps\" (UniqueName: \"kubernetes.io/projected/6e836b1b-2c68-4520-a64c-13c5e29b5a25-kube-api-access-kp7ps\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-system-cni-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-slash\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-netd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-bin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f238319d-82a3-424e-9201-cf2461feecde-tmp-dir\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-node-log\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-os-release\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.034665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5n6\" (UniqueName: \"kubernetes.io/projected/f238319d-82a3-424e-9201-cf2461feecde-kube-api-access-gp5n6\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-dbus\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysconfig\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-run\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-kubelet\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-systemd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-registration-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b2l2\" (UniqueName: \"kubernetes.io/projected/cca1a771-d579-467d-b236-2cdfa9307931-kube-api-access-5b2l2\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-tuned\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-etc-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-ovn\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-config\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d47d1c82-5a69-4246-96d9-739b14e54c86-ovn-node-metrics-cert\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-netns\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-multus\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.152083 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-cnibin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-system-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-k8s-cni-cncf-io\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-daemon-config\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5xq\" (UniqueName: \"kubernetes.io/projected/c8c5c911-3593-4661-8b0a-51ad4ed58856-kube-api-access-fs5xq\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pl5t\" (UniqueName: \"kubernetes.io/projected/384acbff-ca16-40f3-812d-d92f6b03faad-kube-api-access-9pl5t\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-device-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-kubernetes\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.926999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-systemd\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-multus-certs\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/384acbff-ca16-40f3-812d-d92f6b03faad-iptables-alerter-script\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfsj8\" (UniqueName: \"kubernetes.io/projected/b9994a49-bec0-41c3-9b04-9f7873308707-kube-api-access-kfsj8\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-modprobe-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-sys\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.927101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-tmp\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.929197 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.933722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-tmp\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.153396 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-script-lib\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-os-release\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-kubelet-config\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.937566 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.937617 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:17.437600938 +0000 UTC m=+2.311586116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-conf\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-host\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937825 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-netns\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5539e66f-0564-48fc-8ba2-0cf8cc902e64-host\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937896 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-log-socket\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-conf-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-bin\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.937991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.938434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.938499 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:17.154311 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:16.938530 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:17.438519601 +0000 UTC m=+2.312504764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.938598 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-socket-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.938678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysctl-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.938702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-var-lib-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.938929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-env-overrides\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-etc-kubernetes\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384acbff-ca16-40f3-812d-d92f6b03faad-host-slash\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f238319d-82a3-424e-9201-cf2461feecde-hosts-file\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-systemd-units\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-run-ovn-kubernetes\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-socket-dir-parent\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-hostroot\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.939917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-konnectivity-ca\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-cni-binary-copy\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-kubelet\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5539e66f-0564-48fc-8ba2-0cf8cc902e64-serviceca\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-sys-fs\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.156084 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.940981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-lib-modules\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.941012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-var-lib-kubelet\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.941036 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cnibin\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/063694dc-8ddb-41e9-8b84-a4ebd7c966d7-agent-certs\") pod \"konnectivity-agent-zs6cn\" (UID: \"063694dc-8ddb-41e9-8b84-a4ebd7c966d7\") " pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b666d5-ecdb-442a-adf9-d5befbfa0723-system-cni-dir\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-slash\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-cni-netd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-bin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f238319d-82a3-424e-9201-cf2461feecde-tmp-dir\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.943996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944021 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-node-log\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-os-release\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b666d5-ecdb-442a-adf9-d5befbfa0723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27ffe1e7-dba8-4b76-9edc-d5f26479136f-dbus\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944585 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-sysconfig\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-run\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-host-kubelet\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.157006 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-systemd\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.944702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-registration-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.946965 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-tuned\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.947138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-etc-openvswitch\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.947186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d47d1c82-5a69-4246-96d9-739b14e54c86-run-ovn\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.947492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d47d1c82-5a69-4246-96d9-739b14e54c86-ovnkube-config\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d47d1c82-5a69-4246-96d9-739b14e54c86-ovn-node-metrics-cert\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-netns\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949365 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-var-lib-cni-multus\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-cnibin\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-system-cni-dir\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-k8s-cni-cncf-io\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.949769 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8c5c911-3593-4661-8b0a-51ad4ed58856-multus-daemon-config\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-device-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cca1a771-d579-467d-b236-2cdfa9307931-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950124 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-kubernetes\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950174 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-systemd\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8c5c911-3593-4661-8b0a-51ad4ed58856-host-run-multus-certs\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.158354 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/384acbff-ca16-40f3-812d-d92f6b03faad-iptables-alerter-script\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.159270 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-etc-modprobe-d\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.159270 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:16.950821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e836b1b-2c68-4520-a64c-13c5e29b5a25-sys\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.257716 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.257540 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:17.257716 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.257572 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:17.257716 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.257586 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:17.257716 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.257683 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:17.757663233 +0000 UTC m=+2.631648416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:17.260616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.260502 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5xq\" (UniqueName: \"kubernetes.io/projected/c8c5c911-3593-4661-8b0a-51ad4ed58856-kube-api-access-fs5xq\") pod \"multus-tm89x\" (UID: \"c8c5c911-3593-4661-8b0a-51ad4ed58856\") " pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.260616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.260551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6xll\" (UniqueName: \"kubernetes.io/projected/5539e66f-0564-48fc-8ba2-0cf8cc902e64-kube-api-access-d6xll\") pod \"node-ca-d7zt7\" (UID: \"5539e66f-0564-48fc-8ba2-0cf8cc902e64\") " pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.260616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.260551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b2l2\" (UniqueName: \"kubernetes.io/projected/cca1a771-d579-467d-b236-2cdfa9307931-kube-api-access-5b2l2\") pod \"aws-ebs-csi-driver-node-jrvph\" (UID: \"cca1a771-d579-467d-b236-2cdfa9307931\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.260904 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.260848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxbj\" (UniqueName: \"kubernetes.io/projected/c0b666d5-ecdb-442a-adf9-d5befbfa0723-kube-api-access-4mxbj\") pod \"multus-additional-cni-plugins-jhdrr\" (UID: \"c0b666d5-ecdb-442a-adf9-d5befbfa0723\") " pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.260960 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.260919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdxg2\" (UniqueName: \"kubernetes.io/projected/d47d1c82-5a69-4246-96d9-739b14e54c86-kube-api-access-gdxg2\") pod \"ovnkube-node-jq8d2\" (UID: \"d47d1c82-5a69-4246-96d9-739b14e54c86\") " pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.261050 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.261014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5n6\" (UniqueName: \"kubernetes.io/projected/f238319d-82a3-424e-9201-cf2461feecde-kube-api-access-gp5n6\") pod \"node-resolver-bjt68\" (UID: \"f238319d-82a3-424e-9201-cf2461feecde\") " pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.261758 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.261734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pl5t\" (UniqueName: \"kubernetes.io/projected/384acbff-ca16-40f3-812d-d92f6b03faad-kube-api-access-9pl5t\") pod \"iptables-alerter-mdbzm\" (UID: \"384acbff-ca16-40f3-812d-d92f6b03faad\") " pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.262230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.262210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp7ps\" (UniqueName: \"kubernetes.io/projected/6e836b1b-2c68-4520-a64c-13c5e29b5a25-kube-api-access-kp7ps\") pod \"tuned-gqjnp\" (UID: \"6e836b1b-2c68-4520-a64c-13c5e29b5a25\") " pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.262838 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.262817 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfsj8\" (UniqueName: \"kubernetes.io/projected/b9994a49-bec0-41c3-9b04-9f7873308707-kube-api-access-kfsj8\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:17.274085 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.274069 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tm89x" Jul 02 14:01:17.287035 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.286986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bjt68" Jul 02 14:01:17.302740 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.302711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mdbzm" Jul 02 14:01:17.319828 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.319794 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7zt7" Jul 02 14:01:17.336966 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.336942 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" Jul 02 14:01:17.352934 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.352914 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:17.358273 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.358256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:17.389535 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.389512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" Jul 02 14:01:17.408204 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.408176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" Jul 02 14:01:17.530996 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.530944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:17.531193 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.531115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:17.531193 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.531125 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:17.531335 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.531202 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.531178901 +0000 UTC m=+3.405164069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:17.531335 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.531207 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:17.531335 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.531270 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.531243474 +0000 UTC m=+3.405228638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:17.783698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.783601 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:56:17 +0000 UTC" deadline="2027-11-28 19:32:45.452329426 +0000 UTC" Jul 02 14:01:17.783698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.783653 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12341h31m27.668679171s" Jul 02 14:01:17.834384 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.834351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:17.834605 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.834556 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:17.834605 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.834586 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:17.834605 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.834601 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:17.834829 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:17.834677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:18.834655897 +0000 UTC m=+3.708641076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:17.964238 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:17.964198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e836b1b_2c68_4520_a64c_13c5e29b5a25.slice/crio-a0f7434d282cbc711da287cfea3f9b750089265894c26ce8f3ab8b719bad4664 WatchSource:0}: Error finding container a0f7434d282cbc711da287cfea3f9b750089265894c26ce8f3ab8b719bad4664: Status 404 returned error can't find the container with id a0f7434d282cbc711da287cfea3f9b750089265894c26ce8f3ab8b719bad4664 Jul 02 14:01:17.965464 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:17.965438 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5c3d13bf76270246373f4c49b89cdc.slice/crio-bfa3cf692ea74f4f8c55b4e539a9fd8fd2b2e41f6473ca215e3f1afab3d4fe6d WatchSource:0}: Error finding container bfa3cf692ea74f4f8c55b4e539a9fd8fd2b2e41f6473ca215e3f1afab3d4fe6d: Status 404 returned error can't find the container with id bfa3cf692ea74f4f8c55b4e539a9fd8fd2b2e41f6473ca215e3f1afab3d4fe6d Jul 02 14:01:17.965774 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:17.965744 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063694dc_8ddb_41e9_8b84_a4ebd7c966d7.slice/crio-6fbc04928658e7caf97f05bd88617c54bf4695238217afe9df93dc58ef7eaef6 WatchSource:0}: Error finding container 6fbc04928658e7caf97f05bd88617c54bf4695238217afe9df93dc58ef7eaef6: Status 404 returned error can't find the container with id 6fbc04928658e7caf97f05bd88617c54bf4695238217afe9df93dc58ef7eaef6 Jul 02 14:01:17.966431 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:17.966407 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5539e66f_0564_48fc_8ba2_0cf8cc902e64.slice/crio-0aea51a2ed007531b728ed629d75fe01cff6574ed434544c76af195101d8749f WatchSource:0}: Error finding container 0aea51a2ed007531b728ed629d75fe01cff6574ed434544c76af195101d8749f: Status 404 returned error can't find the container with id 0aea51a2ed007531b728ed629d75fe01cff6574ed434544c76af195101d8749f Jul 02 14:01:17.970748 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:17.970730 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:01:18.097190 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:18.097148 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e296f619fb6a1a3c00846ef68feadb4.slice/crio-f0494c3030ca46f33e2feb63bc9568f4676f1fd27f8c568c9ab4d33f3ef788da WatchSource:0}: Error finding container f0494c3030ca46f33e2feb63bc9568f4676f1fd27f8c568c9ab4d33f3ef788da: Status 404 returned error can't find the container with id f0494c3030ca46f33e2feb63bc9568f4676f1fd27f8c568c9ab4d33f3ef788da Jul 02 14:01:18.317041 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:18.317000 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c5c911_3593_4661_8b0a_51ad4ed58856.slice/crio-df9808c9b6b26c4626f923747db06db9a1e36b583eef889048b21cefe18d6809 WatchSource:0}: Error finding container df9808c9b6b26c4626f923747db06db9a1e36b583eef889048b21cefe18d6809: Status 404 returned error can't find the container with id df9808c9b6b26c4626f923747db06db9a1e36b583eef889048b21cefe18d6809 Jul 02 14:01:18.385026 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:18.384974 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b666d5_ecdb_442a_adf9_d5befbfa0723.slice/crio-c3a2fe808d13823370917566936d4d615a4c456673de7801c242cc0cb30abb4d WatchSource:0}: Error finding container c3a2fe808d13823370917566936d4d615a4c456673de7801c242cc0cb30abb4d: Status 404 returned error can't find the container with id c3a2fe808d13823370917566936d4d615a4c456673de7801c242cc0cb30abb4d Jul 02 14:01:18.500881 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:18.500844 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca1a771_d579_467d_b236_2cdfa9307931.slice/crio-3120e55b01ad4eb8b8fcb12620cd12236b115a15c78d691250ac1760974ae7cb WatchSource:0}: Error finding container 3120e55b01ad4eb8b8fcb12620cd12236b115a15c78d691250ac1760974ae7cb: Status 404 returned error can't find the container with id 3120e55b01ad4eb8b8fcb12620cd12236b115a15c78d691250ac1760974ae7cb Jul 02 14:01:18.541533 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.541486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:18.541533 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.541538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:18.541778 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.541687 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:18.541778 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.541751 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:20.541731309 +0000 UTC m=+5.415716491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:18.542125 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.542030 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:18.542125 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.542095 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:20.542078948 +0000 UTC m=+5.416064126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:18.581301 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.581091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:18.581301 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.581240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:18.581301 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.581244 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:18.581595 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.581385 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:18.581595 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.581457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:18.581595 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.581546 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:18.733575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.733363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerStarted","Data":"c3a2fe808d13823370917566936d4d615a4c456673de7801c242cc0cb30abb4d"} Jul 02 14:01:18.735511 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.735480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm89x" event={"ID":"c8c5c911-3593-4661-8b0a-51ad4ed58856","Type":"ContainerStarted","Data":"df9808c9b6b26c4626f923747db06db9a1e36b583eef889048b21cefe18d6809"} Jul 02 14:01:18.738576 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.738505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"6e296f619fb6a1a3c00846ef68feadb4","Type":"ContainerStarted","Data":"f0494c3030ca46f33e2feb63bc9568f4676f1fd27f8c568c9ab4d33f3ef788da"} Jul 02 14:01:18.742932 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.742896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" event={"ID":"6e836b1b-2c68-4520-a64c-13c5e29b5a25","Type":"ContainerStarted","Data":"a0f7434d282cbc711da287cfea3f9b750089265894c26ce8f3ab8b719bad4664"} Jul 02 14:01:18.744782 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.744673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs6cn" event={"ID":"063694dc-8ddb-41e9-8b84-a4ebd7c966d7","Type":"ContainerStarted","Data":"6fbc04928658e7caf97f05bd88617c54bf4695238217afe9df93dc58ef7eaef6"} Jul 02 14:01:18.746337 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.746313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" event={"ID":"4a5c3d13bf76270246373f4c49b89cdc","Type":"ContainerStarted","Data":"bfa3cf692ea74f4f8c55b4e539a9fd8fd2b2e41f6473ca215e3f1afab3d4fe6d"} Jul 02 14:01:18.749654 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.749628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7zt7" event={"ID":"5539e66f-0564-48fc-8ba2-0cf8cc902e64","Type":"ContainerStarted","Data":"0aea51a2ed007531b728ed629d75fe01cff6574ed434544c76af195101d8749f"} Jul 02 14:01:18.751128 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.751086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" event={"ID":"cca1a771-d579-467d-b236-2cdfa9307931","Type":"ContainerStarted","Data":"3120e55b01ad4eb8b8fcb12620cd12236b115a15c78d691250ac1760974ae7cb"} Jul 02 14:01:18.784518 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.784453 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:56:17 +0000 UTC" deadline="2028-02-01 03:04:43.761074939 +0000 UTC" Jul 02 14:01:18.784518 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.784492 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13885h3m24.976588366s" Jul 02 14:01:18.843682 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:18.843038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:18.843682 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.843228 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:18.843682 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.843250 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:18.843682 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.843263 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:18.843682 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:18.843326 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:20.843306063 +0000 UTC m=+5.717291229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:19.006633 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:19.006559 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47d1c82_5a69_4246_96d9_739b14e54c86.slice/crio-8fdd9064dba5a2a24ca437d6a0f1a559d989755ce79c6894648e87582abb08b7 WatchSource:0}: Error finding container 8fdd9064dba5a2a24ca437d6a0f1a559d989755ce79c6894648e87582abb08b7: Status 404 returned error can't find the container with id 8fdd9064dba5a2a24ca437d6a0f1a559d989755ce79c6894648e87582abb08b7 Jul 02 14:01:19.189668 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:19.189535 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384acbff_ca16_40f3_812d_d92f6b03faad.slice/crio-6609a2e97440e483025458681eaffd365f043a14e23f757501e4cda4738392a7 WatchSource:0}: Error finding container 6609a2e97440e483025458681eaffd365f043a14e23f757501e4cda4738392a7: Status 404 returned error can't find the container with id 6609a2e97440e483025458681eaffd365f043a14e23f757501e4cda4738392a7 Jul 02 14:01:19.755970 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:19.755932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mdbzm" event={"ID":"384acbff-ca16-40f3-812d-d92f6b03faad","Type":"ContainerStarted","Data":"6609a2e97440e483025458681eaffd365f043a14e23f757501e4cda4738392a7"} Jul 02 14:01:19.757897 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:19.757863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"8fdd9064dba5a2a24ca437d6a0f1a559d989755ce79c6894648e87582abb08b7"} Jul 02 14:01:20.556214 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.556168 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:20.556834 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.556296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:20.556834 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.556427 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:20.556834 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.556499 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:24.556480512 +0000 UTC m=+9.430465687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:20.556834 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.556429 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:20.556834 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.556578 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:24.556558909 +0000 UTC m=+9.430544088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:20.581546 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.581037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:20.581546 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.581197 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:20.581546 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.581273 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:20.581546 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.581391 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:20.581546 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.581450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:20.581950 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.581572 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:20.860048 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:20.859856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:20.860048 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.860036 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:20.860303 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.860058 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:20.860303 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.860070 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:20.860303 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:20.860168 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:24.860114529 +0000 UTC m=+9.734099693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:22.581668 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:22.581622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:22.582221 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:22.581782 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:22.582221 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:22.582216 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:22.582356 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:22.582310 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:22.582414 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:22.582381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:22.582476 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:22.582462 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.581248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.581297 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.581404 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.581500 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.581561 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:24.581792 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.581651 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:24.595163 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.595135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:24.595348 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.595219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:24.595406 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.595345 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:24.595462 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.595345 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:24.595462 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.595414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:32.595391981 +0000 UTC m=+17.469377161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:24.595579 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.595466 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:32.595451807 +0000 UTC m=+17.469436987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:24.898479 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:24.897713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:24.898479 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.897945 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:24.898479 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.897966 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:24.898479 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.897979 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:24.898479 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:24.898045 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:32.898024914 +0000 UTC m=+17.772010086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:26.581512 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:26.580884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:26.581512 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:26.581007 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:26.581512 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:26.580884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:26.581512 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:26.581360 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:26.581512 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:26.581431 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:26.582172 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:26.581553 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:28.581445 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:28.581346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:28.581445 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:28.581383 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:28.581953 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:28.581475 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:28.581953 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:28.581489 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:28.581953 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:28.581591 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:28.581953 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:28.581666 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:30.580978 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:30.580917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:30.580978 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:30.580966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:30.581464 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:30.580971 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:30.581464 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:30.581050 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:30.581464 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:30.581158 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:30.581464 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:30.581258 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:32.581549 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.581380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:32.581900 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.581414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:32.581900 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.581607 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:32.581900 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.581732 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:32.581900 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.581426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:32.581900 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.581825 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:32.657810 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.657776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:32.657958 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.657842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:32.657958 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.657925 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:32.657958 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.657926 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:32.658058 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.657975 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:01:48.657962948 +0000 UTC m=+33.531948111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:32.658058 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.657989 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:48.657982667 +0000 UTC m=+33.531967829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:32.959739 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:32.959657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:32.959896 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.959847 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:32.959896 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.959875 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:32.959896 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.959889 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:32.960044 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:32.959956 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:48.959935812 +0000 UTC m=+33.833920979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:34.580946 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:34.580910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:34.581416 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:34.581027 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:34.581416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:34.581033 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:34.581416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:34.581142 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:34.581416 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:34.581034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:34.581416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:34.581270 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:36.581476 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:36.581411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:36.581476 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:36.581465 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:36.582005 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:36.581474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:36.582005 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:36.581545 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:36.582005 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:36.581688 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:36.582005 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:36.581785 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:38.581325 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.581294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:38.581997 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.581310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:38.581997 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:38.581428 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:38.581997 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.581310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:38.581997 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:38.581458 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:38.581997 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:38.581533 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:38.795249 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795219 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:01:38.795566 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795543 2565 generic.go:356] "Generic (PLEG): container finished" podID="d47d1c82-5a69-4246-96d9-739b14e54c86" containerID="b5369a5fcb5c126f4248b751ba6f26c4449175dabe8022584e820384f644f880" exitCode=1 Jul 02 14:01:38.795659 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"e86f4aff9be78ebef356b202fda7f71c502df1a9ab203937ba79ea70f77927c2"} Jul 02 14:01:38.795727 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"2c6fc24cfe6856de5a96c3e0fb9b5525ca2310ef0280e053cdb415ef6472e4fc"} Jul 02 14:01:38.795782 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"81c4ff956d683be533735558616d548259b8e77dde009bd8614dde34f53dc0d0"} Jul 02 14:01:38.795835 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"8ab3fef5a9cf25d7955307209b34cf6df7e0fb7835fd9fcde399b88180483c77"} Jul 02 14:01:38.795835 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerDied","Data":"b5369a5fcb5c126f4248b751ba6f26c4449175dabe8022584e820384f644f880"} Jul 02 14:01:38.795908 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.795850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"a47fa76351a0e6661eebac60ec9dcf1d78b786f85fef69b50126984ce7e748f1"} Jul 02 14:01:38.796925 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.796900 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjt68" event={"ID":"f238319d-82a3-424e-9201-cf2461feecde","Type":"ContainerStarted","Data":"abf0b4b6d9aa9e2f8dd3c45e252a5fdc0f62a52f4c2da703e99574f0060fa203"} Jul 02 14:01:38.797029 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.796940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bjt68" event={"ID":"f238319d-82a3-424e-9201-cf2461feecde","Type":"ContainerStarted","Data":"9aec015a4d4406960746d5ecef837a58f0ebd835b6484e0b16270ef8db62bc6c"} Jul 02 14:01:38.798290 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.798266 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="d1adff2d8e69d90b3fce339974eff54cab9ca93cbd7899aaea58bdd4ee0325ad" exitCode=0 Jul 02 14:01:38.798390 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.798328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"d1adff2d8e69d90b3fce339974eff54cab9ca93cbd7899aaea58bdd4ee0325ad"} Jul 02 14:01:38.799747 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.799728 2565 generic.go:356] "Generic (PLEG): container finished" podID="6e296f619fb6a1a3c00846ef68feadb4" containerID="6d0780b64553eb753f64103591071f1ca5f8cc4aa5f9037e1356ece8aaa54fe0" exitCode=0 Jul 02 14:01:38.799808 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.799798 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"6e296f619fb6a1a3c00846ef68feadb4","Type":"ContainerDied","Data":"6d0780b64553eb753f64103591071f1ca5f8cc4aa5f9037e1356ece8aaa54fe0"} Jul 02 14:01:38.801428 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.801407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" event={"ID":"6e836b1b-2c68-4520-a64c-13c5e29b5a25","Type":"ContainerStarted","Data":"d270a96b0bf0c67ad899833ac72b35a0dee6df0bd6017d9c5df25880414c0699"} Jul 02 14:01:38.802891 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.802870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7zt7" event={"ID":"5539e66f-0564-48fc-8ba2-0cf8cc902e64","Type":"ContainerStarted","Data":"8684968e79378962e98125700cea5ff09cf6fc10f4b0aee4ce463fa8b6e7c047"} Jul 02 14:01:38.804205 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.804185 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" event={"ID":"cca1a771-d579-467d-b236-2cdfa9307931","Type":"ContainerStarted","Data":"7197f1dbda2cce7264cf8c76b0b3cecd5a3ce545574fc2099f5d468eacefc00b"} Jul 02 14:01:38.805413 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.805392 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tm89x" event={"ID":"c8c5c911-3593-4661-8b0a-51ad4ed58856","Type":"ContainerStarted","Data":"725aac35df7630b576f981da499c0bb34fe050dd7f7f3df3b6f2c974f1f0a261"} Jul 02 14:01:38.806546 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.806521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs6cn" event={"ID":"063694dc-8ddb-41e9-8b84-a4ebd7c966d7","Type":"ContainerStarted","Data":"3a32da57ee817fed621b96193c5b12d5dae45e7d4269c6eea3160811d527c149"} Jul 02 14:01:38.807670 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.807653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" event={"ID":"4a5c3d13bf76270246373f4c49b89cdc","Type":"ContainerStarted","Data":"d92b51cfe0a01dbba2ec642049122ee50767b2cc9d6b3541fc0ce9bd74c2f786"} Jul 02 14:01:38.815950 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.815909 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bjt68" podStartSLOduration=22.815898059 podStartE2EDuration="22.815898059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.815539133 +0000 UTC m=+23.689524317" watchObservedRunningTime="2026-07-02 14:01:38.815898059 +0000 UTC m=+23.689883244" Jul 02 14:01:38.832430 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.832395 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gqjnp" podStartSLOduration=2.89375222 podStartE2EDuration="22.832383803s" totalImagesPullingTime="19.938631583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.831975014 +0000 UTC m=+23.705960198" watchObservedRunningTime="2026-07-02 14:01:38.832383803 +0000 UTC m=+23.706368987" Jul 02 14:01:38.847467 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.847294 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d7zt7" podStartSLOduration=8.972198865 podStartE2EDuration="22.847279255s" totalImagesPullingTime="13.87508039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.847119034 +0000 UTC m=+23.721104219" watchObservedRunningTime="2026-07-02 14:01:38.847279255 +0000 UTC m=+23.721264439" Jul 02 14:01:38.862181 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.861888 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zs6cn" podStartSLOduration=8.276101195 podStartE2EDuration="22.861878603s" totalImagesPullingTime="14.585777408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.861528989 +0000 UTC m=+23.735514174" watchObservedRunningTime="2026-07-02 14:01:38.861878603 +0000 UTC m=+23.735863787" Jul 02 14:01:38.876633 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.876603 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-214.ec2.internal" podStartSLOduration=22.876591926 podStartE2EDuration="22.876591926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.876448222 +0000 UTC m=+23.750433406" watchObservedRunningTime="2026-07-02 14:01:38.876591926 +0000 UTC m=+23.750577109" Jul 02 14:01:38.897942 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:38.897903 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tm89x" podStartSLOduration=3.304245331 podStartE2EDuration="22.89789015s" totalImagesPullingTime="19.593644819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:38.897213056 +0000 UTC m=+23.771198239" watchObservedRunningTime="2026-07-02 14:01:38.89789015 +0000 UTC m=+23.771875333" Jul 02 14:01:39.592305 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.592278 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 14:01:39.737847 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.737634 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:01:39.59230162Z","UUID":"69204a0a-9e3e-4e61-b640-ec307fbd5a52","Handler":null,"Name":"","Endpoint":""} Jul 02 14:01:39.739037 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.739018 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 14:01:39.739162 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.739053 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 14:01:39.812244 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.812204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" event={"ID":"cca1a771-d579-467d-b236-2cdfa9307931","Type":"ContainerStarted","Data":"bb76cefc63d0f300159b41f479957a1566e985c0ad29ddd1fc3e8d36f04d1f13"} Jul 02 14:01:39.813723 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.813695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mdbzm" event={"ID":"384acbff-ca16-40f3-812d-d92f6b03faad","Type":"ContainerStarted","Data":"a282900307044d3cc0c5673262af525dcf28a429923b7b074e3f07053c55e70f"} Jul 02 14:01:39.815576 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.815548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" event={"ID":"6e296f619fb6a1a3c00846ef68feadb4","Type":"ContainerStarted","Data":"8af2908752e3590f0c087ca5f268d63104670d70db99e31ad634384fdd3c33ad"} Jul 02 14:01:39.828334 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.828287 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mdbzm" podStartSLOduration=5.10788311 podStartE2EDuration="23.828274667s" totalImagesPullingTime="18.720391557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:39.82812625 +0000 UTC m=+24.702111434" watchObservedRunningTime="2026-07-02 14:01:39.828274667 +0000 UTC m=+24.702259850" Jul 02 14:01:39.842512 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:39.842466 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-214.ec2.internal" podStartSLOduration=23.842449144 podStartE2EDuration="23.842449144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:39.841715601 +0000 UTC m=+24.715700788" watchObservedRunningTime="2026-07-02 14:01:39.842449144 +0000 UTC m=+24.716434333" Jul 02 14:01:40.581359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.581323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:40.581538 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.581340 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:40.581538 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:40.581462 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:40.581538 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.581512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:40.581696 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:40.581585 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:40.581696 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:40.581667 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:40.819969 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.819887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" event={"ID":"cca1a771-d579-467d-b236-2cdfa9307931","Type":"ContainerStarted","Data":"7d8a4034893369c2a09f368d53ce73f158c3b928707cfcef6116c96ff2ed0bd5"} Jul 02 14:01:40.823525 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.823502 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:01:40.823941 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.823909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"909f40f073e4e780fabdb2c20193c45eab25b92a24d440a0e276d011a97378e0"} Jul 02 14:01:40.838907 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:40.838852 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrvph" podStartSLOduration=3.248809875 podStartE2EDuration="24.83883343s" totalImagesPullingTime="21.590023555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:40.837841998 +0000 UTC m=+25.711827195" watchObservedRunningTime="2026-07-02 14:01:40.83883343 +0000 UTC m=+25.712818615" Jul 02 14:01:41.598049 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:41.598016 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:41.598591 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:41.598569 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:41.827167 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:41.826810 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:41.827571 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:41.827278 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zs6cn" Jul 02 14:01:42.581154 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:42.581123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:42.581337 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:42.581123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:42.581337 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:42.581123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:42.581337 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:42.581268 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:42.581491 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:42.581336 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:42.581491 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:42.581385 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:43.834554 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.834337 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:01:43.835376 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.834844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"0f35e4b0edac0261194bae63f2a33cdb234b1a250981eb8d7e051e64508563b7"} Jul 02 14:01:43.835376 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.835120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:43.835376 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.835182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:43.835376 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.835362 2565 scope.go:117] "RemoveContainer" containerID="b5369a5fcb5c126f4248b751ba6f26c4449175dabe8022584e820384f644f880" Jul 02 14:01:43.839825 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.839795 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="1951ebbf05a9f08101e8a70eadd31890c39417d5228357c63d37659d08038819" exitCode=0 Jul 02 14:01:43.840147 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.840126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"1951ebbf05a9f08101e8a70eadd31890c39417d5228357c63d37659d08038819"} Jul 02 14:01:43.851472 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:43.851454 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:44.580907 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.580828 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:44.581107 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.580928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:44.581107 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:44.580937 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:44.581107 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.580959 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:44.581107 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:44.581046 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:44.581265 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:44.581126 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:44.846320 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.846250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:01:44.846733 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.846603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" event={"ID":"d47d1c82-5a69-4246-96d9-739b14e54c86","Type":"ContainerStarted","Data":"b71b40dcfa4e4f1a1e97e5686db8c4c3153c12cbaa58684194205858b8e3228a"} Jul 02 14:01:44.846869 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.846854 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:44.862431 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.862407 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:01:44.875027 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:44.874984 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" podStartSLOduration=9.883468852 podStartE2EDuration="28.874971532s" totalImagesPullingTime="18.99150268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:44.873478269 +0000 UTC m=+29.747463454" watchObservedRunningTime="2026-07-02 14:01:44.874971532 +0000 UTC m=+29.748956731" Jul 02 14:01:45.565152 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.564962 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mmpqd"] Jul 02 14:01:45.565328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.565286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:45.565416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:45.565393 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:45.568061 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.568034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pllm"] Jul 02 14:01:45.568191 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.568154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:45.568268 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:45.568244 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:45.568815 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.568791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmt8p"] Jul 02 14:01:45.568925 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.568893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:45.569011 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:45.568992 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:45.850324 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.850294 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="1ef723877bd67e32746e8998b72bf37ce6b1b5cdb82ccad71c8eecb1c1931583" exitCode=0 Jul 02 14:01:45.850769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:45.850373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"1ef723877bd67e32746e8998b72bf37ce6b1b5cdb82ccad71c8eecb1c1931583"} Jul 02 14:01:46.855775 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:46.855741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerStarted","Data":"0900c29c23a6c66d4a89b22065b0040b311cde02616867345d3db0c603f273a7"} Jul 02 14:01:47.581370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:47.581337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:47.581551 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:47.581337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:47.581551 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:47.581459 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:47.581551 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:47.581480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:47.581700 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:47.581590 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:47.581750 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:47.581689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:47.860412 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:47.860314 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="0900c29c23a6c66d4a89b22065b0040b311cde02616867345d3db0c603f273a7" exitCode=0 Jul 02 14:01:47.860412 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:47.860356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"0900c29c23a6c66d4a89b22065b0040b311cde02616867345d3db0c603f273a7"} Jul 02 14:01:48.673777 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:48.673738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:48.673943 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:48.673841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:48.673943 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.673862 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:48.673943 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.673938 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:20.673918022 +0000 UTC m=+65.547903206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:01:48.673943 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.673940 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:48.674188 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.673985 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret podName:27ffe1e7-dba8-4b76-9edc-d5f26479136f nodeName:}" failed. No retries permitted until 2026-07-02 14:02:20.673970504 +0000 UTC m=+65.547955689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret") pod "global-pull-secret-syncer-7pllm" (UID: "27ffe1e7-dba8-4b76-9edc-d5f26479136f") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:01:48.976449 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:48.976367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:48.976815 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.976556 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:01:48.976815 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.976587 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:01:48.976815 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.976600 2565 projected.go:196] Error preparing data for projected volume kube-api-access-x5xb5 for pod openshift-network-diagnostics/network-check-target-mmpqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:48.976815 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:48.976668 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5 podName:08d4f144-e9cb-4eff-a9b6-7b5638c81aa7 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:20.976647246 +0000 UTC m=+65.850632413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x5xb5" (UniqueName: "kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5") pod "network-check-target-mmpqd" (UID: "08d4f144-e9cb-4eff-a9b6-7b5638c81aa7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:01:49.581602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:49.581563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:49.581881 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:49.581564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:49.581881 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:49.581681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:49.581881 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:49.581679 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pllm" podUID="27ffe1e7-dba8-4b76-9edc-d5f26479136f" Jul 02 14:01:49.581881 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:49.581766 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:01:49.581881 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:49.581863 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mmpqd" podUID="08d4f144-e9cb-4eff-a9b6-7b5638c81aa7" Jul 02 14:01:50.857430 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.857197 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-214.ec2.internal" event="NodeReady" Jul 02 14:01:50.857806 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.857480 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 14:01:50.904186 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.904154 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8v9qr"] Jul 02 14:01:50.925965 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.925935 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rskpz"] Jul 02 14:01:50.926148 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.926092 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:50.928611 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.928590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 14:01:50.928749 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.928590 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 14:01:50.928840 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.928820 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h8n4j\"" Jul 02 14:01:50.937143 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.937124 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8v9qr"] Jul 02 14:01:50.937239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.937154 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rskpz"] Jul 02 14:01:50.937239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.937229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:50.939742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.939571 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 14:01:50.939742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.939606 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 14:01:50.939742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.939615 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rsdvs\"" Jul 02 14:01:50.939742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.939691 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 14:01:50.993950 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.993898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tglf\" (UniqueName: \"kubernetes.io/projected/468ce41d-4e3c-4e90-8bc7-b00bc2236367-kube-api-access-5tglf\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:50.993950 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.993943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/468ce41d-4e3c-4e90-8bc7-b00bc2236367-tmp-dir\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:50.994235 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.993993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/468ce41d-4e3c-4e90-8bc7-b00bc2236367-config-volume\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:50.994235 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:50.994072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095242 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tglf\" (UniqueName: \"kubernetes.io/projected/468ce41d-4e3c-4e90-8bc7-b00bc2236367-kube-api-access-5tglf\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095428 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/468ce41d-4e3c-4e90-8bc7-b00bc2236367-tmp-dir\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095428 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/468ce41d-4e3c-4e90-8bc7-b00bc2236367-config-volume\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095428 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095428 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e481ff-00ad-4387-8681-b7a27251472a-cert\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.095602 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:51.095433 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:51.095602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptqf\" (UniqueName: \"kubernetes.io/projected/73e481ff-00ad-4387-8681-b7a27251472a-kube-api-access-cptqf\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.095602 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:51.095487 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:51.595471327 +0000 UTC m=+36.469456489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:01:51.095715 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/468ce41d-4e3c-4e90-8bc7-b00bc2236367-tmp-dir\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.095948 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.095929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/468ce41d-4e3c-4e90-8bc7-b00bc2236367-config-volume\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.106676 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.106651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tglf\" (UniqueName: \"kubernetes.io/projected/468ce41d-4e3c-4e90-8bc7-b00bc2236367-kube-api-access-5tglf\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.196995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.196912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e481ff-00ad-4387-8681-b7a27251472a-cert\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.196995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.196956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptqf\" (UniqueName: \"kubernetes.io/projected/73e481ff-00ad-4387-8681-b7a27251472a-kube-api-access-cptqf\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.199757 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.199731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73e481ff-00ad-4387-8681-b7a27251472a-cert\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.205513 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.205489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptqf\" (UniqueName: \"kubernetes.io/projected/73e481ff-00ad-4387-8681-b7a27251472a-kube-api-access-cptqf\") pod \"ingress-canary-rskpz\" (UID: \"73e481ff-00ad-4387-8681-b7a27251472a\") " pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.246560 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.246527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rskpz" Jul 02 14:01:51.588515 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.588440 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:01:51.588515 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.588460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:01:51.588515 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.588461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:01:51.591244 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.591219 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:01:51.591244 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.591260 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:01:51.591501 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.591297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8jwt\"" Jul 02 14:01:51.592364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.592270 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxltc\"" Jul 02 14:01:51.592364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.592296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:01:51.592364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.592322 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:01:51.599712 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:51.599691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:51.599845 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:51.599824 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:51.599947 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:51.599879 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:52.599865669 +0000 UTC m=+37.473850832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:01:52.202261 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:52.202232 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rskpz"] Jul 02 14:01:52.287531 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:01:52.286218 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e481ff_00ad_4387_8681_b7a27251472a.slice/crio-7ebe50546eaffa8557c742f1c3e56fcdabfc760462372992e6ca042edfc64d4b WatchSource:0}: Error finding container 7ebe50546eaffa8557c742f1c3e56fcdabfc760462372992e6ca042edfc64d4b: Status 404 returned error can't find the container with id 7ebe50546eaffa8557c742f1c3e56fcdabfc760462372992e6ca042edfc64d4b Jul 02 14:01:52.608640 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:52.608419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:52.608640 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:52.608573 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:52.608800 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:52.608658 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:54.608643184 +0000 UTC m=+39.482628350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:01:52.876161 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:52.876069 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="4c6220ceb6639be742663f01eea6b71035e548927c9854714e464cd60e40184a" exitCode=0 Jul 02 14:01:52.876161 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:52.876107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"4c6220ceb6639be742663f01eea6b71035e548927c9854714e464cd60e40184a"} Jul 02 14:01:52.877311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:52.877292 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rskpz" event={"ID":"73e481ff-00ad-4387-8681-b7a27251472a","Type":"ContainerStarted","Data":"7ebe50546eaffa8557c742f1c3e56fcdabfc760462372992e6ca042edfc64d4b"} Jul 02 14:01:53.884177 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:53.884140 2565 generic.go:356] "Generic (PLEG): container finished" podID="c0b666d5-ecdb-442a-adf9-d5befbfa0723" containerID="0fa61ed8aab392207b8cb3ad2cb41ab419e9151001d503c43aaa354ded75daf3" exitCode=0 Jul 02 14:01:53.884616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:53.884208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerDied","Data":"0fa61ed8aab392207b8cb3ad2cb41ab419e9151001d503c43aaa354ded75daf3"} Jul 02 14:01:54.624402 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:54.624360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:54.624583 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:54.624482 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:54.624583 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:54.624555 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:01:58.624535087 +0000 UTC m=+43.498520249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:01:54.891523 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:54.891443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" event={"ID":"c0b666d5-ecdb-442a-adf9-d5befbfa0723","Type":"ContainerStarted","Data":"874547490a60444b113cf4fd7480925c0ba579c6d0894d5d6f423c3a26ae9a17"} Jul 02 14:01:54.915360 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:54.915276 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jhdrr" podStartSLOduration=13.884700712 podStartE2EDuration="38.915259303s" totalImagesPullingTime="25.030558591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:54.915124201 +0000 UTC m=+39.789109387" watchObservedRunningTime="2026-07-02 14:01:54.915259303 +0000 UTC m=+39.789244490" Jul 02 14:01:55.894747 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:55.894714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rskpz" event={"ID":"73e481ff-00ad-4387-8681-b7a27251472a","Type":"ContainerStarted","Data":"1df8e25b9be20e1965c13ae6bdffdfc19cacc8e3aae1af32f9c0730435ee1b4f"} Jul 02 14:01:58.651421 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:01:58.651246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:01:58.651421 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:58.651410 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:01:58.651844 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:01:58.651483 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:06.651463985 +0000 UTC m=+51.525449148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:02:06.709782 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:06.709743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:02:06.710347 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:06.709894 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:06.710347 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:06.709962 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:22.709947623 +0000 UTC m=+67.583932784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:02:16.866350 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:16.866318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jq8d2" Jul 02 14:02:16.893131 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:16.893057 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rskpz" podStartSLOduration=23.804135963 podStartE2EDuration="26.893043503s" totalImagesPullingTime="3.08890754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:01:55.927350068 +0000 UTC m=+40.801335256" watchObservedRunningTime="2026-07-02 14:02:16.893043503 +0000 UTC m=+61.767028688" Jul 02 14:02:20.709187 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:20.709141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:02:20.709187 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:20.709188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:02:20.711735 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:20.711709 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:02:20.711863 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:20.711771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:02:20.719776 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:20.719750 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:02:20.719882 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:20.719836 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:03:24.719815306 +0000 UTC m=+129.593800469 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : secret "metrics-daemon-secret" not found Jul 02 14:02:20.723204 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:20.723183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27ffe1e7-dba8-4b76-9edc-d5f26479136f-original-pull-secret\") pod \"global-pull-secret-syncer-7pllm\" (UID: \"27ffe1e7-dba8-4b76-9edc-d5f26479136f\") " pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:02:21.007016 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.006929 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pllm" Jul 02 14:02:21.011053 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.011033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:02:21.013732 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.013704 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:02:21.024549 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.024526 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:02:21.035058 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.035030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5xb5\" (UniqueName: \"kubernetes.io/projected/08d4f144-e9cb-4eff-a9b6-7b5638c81aa7-kube-api-access-x5xb5\") pod \"network-check-target-mmpqd\" (UID: \"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7\") " pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:02:21.128125 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.128094 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pllm"] Jul 02 14:02:21.131768 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:02:21.131742 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ffe1e7_dba8_4b76_9edc_d5f26479136f.slice/crio-271eb04685e749f15c6c12a9d02d8c0c8ae19c6c44a972fd0d1180173c7d2d8e WatchSource:0}: Error finding container 271eb04685e749f15c6c12a9d02d8c0c8ae19c6c44a972fd0d1180173c7d2d8e: Status 404 returned error can't find the container with id 271eb04685e749f15c6c12a9d02d8c0c8ae19c6c44a972fd0d1180173c7d2d8e Jul 02 14:02:21.315295 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.315261 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxltc\"" Jul 02 14:02:21.323322 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.323293 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:02:21.443135 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.443104 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mmpqd"] Jul 02 14:02:21.445809 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:02:21.445774 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d4f144_e9cb_4eff_a9b6_7b5638c81aa7.slice/crio-59caf3fd01cd3569c8191a9906ddde6c4ab062d05357f635b79ca8eeef09908c WatchSource:0}: Error finding container 59caf3fd01cd3569c8191a9906ddde6c4ab062d05357f635b79ca8eeef09908c: Status 404 returned error can't find the container with id 59caf3fd01cd3569c8191a9906ddde6c4ab062d05357f635b79ca8eeef09908c Jul 02 14:02:21.953219 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.953174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pllm" event={"ID":"27ffe1e7-dba8-4b76-9edc-d5f26479136f","Type":"ContainerStarted","Data":"271eb04685e749f15c6c12a9d02d8c0c8ae19c6c44a972fd0d1180173c7d2d8e"} Jul 02 14:02:21.954448 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:21.954416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mmpqd" event={"ID":"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7","Type":"ContainerStarted","Data":"59caf3fd01cd3569c8191a9906ddde6c4ab062d05357f635b79ca8eeef09908c"} Jul 02 14:02:22.722515 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:22.722467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:02:22.722693 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:22.722622 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:22.722745 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:22.722727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:02:54.722703774 +0000 UTC m=+99.596688953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:02:24.964268 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:24.964232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pllm" event={"ID":"27ffe1e7-dba8-4b76-9edc-d5f26479136f","Type":"ContainerStarted","Data":"bb95121d09ab55c9130e9ffac3c08573a76a8f9a5761b74362c86ab3cd90f3b6"} Jul 02 14:02:24.980839 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:24.980789 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7pllm" podStartSLOduration=65.309400304 podStartE2EDuration="1m8.98077349s" totalImagesPullingTime="3.671373186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:24.97967044 +0000 UTC m=+69.853655624" watchObservedRunningTime="2026-07-02 14:02:24.98077349 +0000 UTC m=+69.854758674" Jul 02 14:02:27.972709 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:27.972675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mmpqd" event={"ID":"08d4f144-e9cb-4eff-a9b6-7b5638c81aa7","Type":"ContainerStarted","Data":"71dd96be29792514451999ad3ec91cacda16a9c189aebf64faf7bbfc9a762816"} Jul 02 14:02:27.973145 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:27.972799 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:02:27.990125 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:27.990046 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mmpqd" podStartSLOduration=65.929794245 podStartE2EDuration="1m11.990027786s" totalImagesPullingTime="6.060233541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:27.989324871 +0000 UTC m=+72.863310055" watchObservedRunningTime="2026-07-02 14:02:27.990027786 +0000 UTC m=+72.864012973" Jul 02 14:02:46.330144 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.330018 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm"] Jul 02 14:02:46.332655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.332639 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.335407 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.335385 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 14:02:46.335522 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.335430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 14:02:46.336665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.336646 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 14:02:46.336665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.336657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lnv7r\"" Jul 02 14:02:46.336799 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.336655 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 14:02:46.343521 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.343502 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm"] Jul 02 14:02:46.355760 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.355734 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r"] Jul 02 14:02:46.357802 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.357787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.360661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.360640 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 14:02:46.360661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.360652 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 14:02:46.360916 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.360900 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 14:02:46.360992 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.360901 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 14:02:46.370390 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.370373 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r"] Jul 02 14:02:46.384007 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.383988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.384118 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.384118 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.384118 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmtmg\" (UniqueName: \"kubernetes.io/projected/e9ba4d42-a76d-442f-8290-18a06901ef5d-kube-api-access-kmtmg\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.384118 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wrx\" (UniqueName: \"kubernetes.io/projected/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-kube-api-access-c9wrx\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.384287 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ba4d42-a76d-442f-8290-18a06901ef5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.384287 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.384287 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.384209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485211 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ba4d42-a76d-442f-8290-18a06901ef5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.485613 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485613 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485613 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmtmg\" (UniqueName: \"kubernetes.io/projected/e9ba4d42-a76d-442f-8290-18a06901ef5d-kube-api-access-kmtmg\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.485613 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485535 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wrx\" (UniqueName: \"kubernetes.io/projected/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-kube-api-access-c9wrx\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.485940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.485916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ba4d42-a76d-442f-8290-18a06901ef5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.487834 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.487804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.488038 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.488017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.488116 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.488063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.488194 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.488175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-ca\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.488299 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.488285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e9ba4d42-a76d-442f-8290-18a06901ef5d-hub\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.493524 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.493505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmtmg\" (UniqueName: \"kubernetes.io/projected/e9ba4d42-a76d-442f-8290-18a06901ef5d-kube-api-access-kmtmg\") pod \"cluster-proxy-proxy-agent-cc57b5fc9-qkh2r\" (UID: \"e9ba4d42-a76d-442f-8290-18a06901ef5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.493908 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.493887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wrx\" (UniqueName: \"kubernetes.io/projected/3ab49bd1-9608-42bb-a45c-5fbbe55df62c-kube-api-access-c9wrx\") pod \"managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm\" (UID: \"3ab49bd1-9608-42bb-a45c-5fbbe55df62c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.653481 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.653386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" Jul 02 14:02:46.665927 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.665903 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:02:46.781184 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.781069 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm"] Jul 02 14:02:46.798044 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:46.798017 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r"] Jul 02 14:02:46.801287 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:02:46.801255 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9ba4d42_a76d_442f_8290_18a06901ef5d.slice/crio-35e93138e59cf01139be1418af2b790c09c6483861a1222f4b490621a53de047 WatchSource:0}: Error finding container 35e93138e59cf01139be1418af2b790c09c6483861a1222f4b490621a53de047: Status 404 returned error can't find the container with id 35e93138e59cf01139be1418af2b790c09c6483861a1222f4b490621a53de047 Jul 02 14:02:47.018208 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:47.018104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerStarted","Data":"35e93138e59cf01139be1418af2b790c09c6483861a1222f4b490621a53de047"} Jul 02 14:02:47.019141 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:47.019114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" event={"ID":"3ab49bd1-9608-42bb-a45c-5fbbe55df62c","Type":"ContainerStarted","Data":"9fb93b324654eaecd43080f29250a2ec07fa77cd65427ddefc424ea1496a5ad4"} Jul 02 14:02:52.036143 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.036112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerStarted","Data":"8b6afcffe2b360afffde5fbf79aab5c3c3f772552c0e1f05bc0f1684f3ce3f01"} Jul 02 14:02:52.036568 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.036158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerStarted","Data":"68f9a12db1f1c5a4d0cdca8cae85eca883f66661172a131d34082ebc51dfd78f"} Jul 02 14:02:52.036568 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.036176 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerStarted","Data":"130fa06919e73fe65320556a301db632427bd758f379910c54b7f98a7e0e20eb"} Jul 02 14:02:52.040871 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.040842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" event={"ID":"3ab49bd1-9608-42bb-a45c-5fbbe55df62c","Type":"ContainerStarted","Data":"a0757cecbab25d177146409918a2963ec49aa615473b6781ba0392ff4898ec90"} Jul 02 14:02:52.054706 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.054661 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" podStartSLOduration=1.723844743 podStartE2EDuration="6.054647461s" totalImagesPullingTime="4.330802718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:52.05362916 +0000 UTC m=+96.927614343" watchObservedRunningTime="2026-07-02 14:02:52.054647461 +0000 UTC m=+96.928632623" Jul 02 14:02:52.068526 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:52.068473 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" podStartSLOduration=1.733014527 podStartE2EDuration="6.06845922s" totalImagesPullingTime="4.335444693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:02:52.067935298 +0000 UTC m=+96.941920493" watchObservedRunningTime="2026-07-02 14:02:52.06845922 +0000 UTC m=+96.942444405" Jul 02 14:02:54.745059 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:54.745019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:02:54.745460 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:54.745196 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:02:54.745460 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:02:54.745261 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:03:58.745246151 +0000 UTC m=+163.619231312 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:02:58.977592 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:02:58.977556 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mmpqd" Jul 02 14:03:24.756951 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:03:24.756910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:03:24.757416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:24.757038 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:03:24.757416 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:24.757121 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:26.757106216 +0000 UTC m=+251.631091378 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : secret "metrics-daemon-secret" not found Jul 02 14:03:53.937203 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:53.937154 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8v9qr" podUID="468ce41d-4e3c-4e90-8bc7-b00bc2236367" Jul 02 14:03:54.215689 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:03:54.215609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:03:54.600396 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:54.600363 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:03:58.799192 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:03:58.799139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:03:58.799586 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:58.799270 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:03:58.799586 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:03:58.799320 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls podName:468ce41d-4e3c-4e90-8bc7-b00bc2236367 nodeName:}" failed. No retries permitted until 2026-07-02 14:06:00.799307481 +0000 UTC m=+285.673292644 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls") pod "dns-default-8v9qr" (UID: "468ce41d-4e3c-4e90-8bc7-b00bc2236367") : secret "dns-default-metrics-tls" not found Jul 02 14:04:05.584933 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:04:05.584899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:04:51.378427 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:04:51.378391 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ab49bd1-9608-42bb-a45c-5fbbe55df62c" containerID="a0757cecbab25d177146409918a2963ec49aa615473b6781ba0392ff4898ec90" exitCode=255 Jul 02 14:04:51.378856 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:04:51.378466 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" event={"ID":"3ab49bd1-9608-42bb-a45c-5fbbe55df62c","Type":"ContainerDied","Data":"a0757cecbab25d177146409918a2963ec49aa615473b6781ba0392ff4898ec90"} Jul 02 14:04:51.378856 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:04:51.378749 2565 scope.go:117] "RemoveContainer" containerID="a0757cecbab25d177146409918a2963ec49aa615473b6781ba0392ff4898ec90" Jul 02 14:04:52.382634 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:04:52.382598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9fbd7cfd-br2jm" event={"ID":"3ab49bd1-9608-42bb-a45c-5fbbe55df62c","Type":"ContainerStarted","Data":"a129a5585c9aab421795e342d8641d4d1636690aef1d39c4dc32d7a4a309d1a9"} Jul 02 14:05:26.808047 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:26.808001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:05:26.808555 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:26.808170 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:05:26.808555 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:26.808245 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs podName:b9994a49-bec0-41c3-9b04-9f7873308707 nodeName:}" failed. No retries permitted until 2026-07-02 14:07:28.808230867 +0000 UTC m=+373.682216030 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs") pod "network-metrics-daemon-fmt8p" (UID: "b9994a49-bec0-41c3-9b04-9f7873308707") : secret "metrics-daemon-secret" not found Jul 02 14:05:32.269436 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.269397 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-splww"] Jul 02 14:05:32.272522 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.272503 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.280525 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.280506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 14:05:32.283452 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.283437 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 14:05:32.283652 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.283639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cfxtg\"" Jul 02 14:05:32.286558 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.286542 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 14:05:32.286639 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.286547 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 14:05:32.308581 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.308556 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-splww"] Jul 02 14:05:32.445418 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.445375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.445580 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.445434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835bdb88-f038-42f2-ae8d-6c4070dfeea8-crio-socket\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.445580 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.445471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.445580 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.445502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835bdb88-f038-42f2-ae8d-6c4070dfeea8-data-volume\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.445580 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.445534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9fr\" (UniqueName: \"kubernetes.io/projected/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-api-access-7q9fr\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.546750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.546726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9fr\" (UniqueName: \"kubernetes.io/projected/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-api-access-7q9fr\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.546901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.546768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.546901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.546872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835bdb88-f038-42f2-ae8d-6c4070dfeea8-crio-socket\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.547013 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.546959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.547013 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:32.546980 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:32.547133 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.547012 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/835bdb88-f038-42f2-ae8d-6c4070dfeea8-crio-socket\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.547133 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.546988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835bdb88-f038-42f2-ae8d-6c4070dfeea8-data-volume\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.547133 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:32.547063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:33.047041786 +0000 UTC m=+257.921026966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:32.547133 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:32.547096 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:32.547277 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:32.547158 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:33.047144819 +0000 UTC m=+257.921129994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : configmap "kube-rbac-proxy" not found Jul 02 14:05:32.547277 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.547243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/835bdb88-f038-42f2-ae8d-6c4070dfeea8-data-volume\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:32.563895 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:32.563868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9fr\" (UniqueName: \"kubernetes.io/projected/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-api-access-7q9fr\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:33.050498 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:33.050464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:33.050658 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:33.050523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:33.050658 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:33.050626 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:33.050727 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:33.050690 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.050676469 +0000 UTC m=+258.924661634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:33.050727 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:33.050626 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:33.050810 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:33.050755 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:34.050742722 +0000 UTC m=+258.924727899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : configmap "kube-rbac-proxy" not found Jul 02 14:05:33.975270 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:33.975242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjt68_f238319d-82a3-424e-9201-cf2461feecde/dns-node-resolver/0.log" Jul 02 14:05:34.059329 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:34.059293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:34.059458 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:34.059347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:34.059458 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:34.059423 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:34.059458 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:34.059444 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:34.059574 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:34.059498 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:36.059478916 +0000 UTC m=+260.933464110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : configmap "kube-rbac-proxy" not found Jul 02 14:05:34.059574 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:34.059515 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:36.059508949 +0000 UTC m=+260.933494111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:35.174172 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:35.174145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7zt7_5539e66f-0564-48fc-8ba2-0cf8cc902e64/node-ca/0.log" Jul 02 14:05:36.076769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:36.076735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:36.076986 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:36.076814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:36.076986 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:36.076892 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:36.076986 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:36.076918 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:36.076986 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:36.076960 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:40.076944991 +0000 UTC m=+264.950930157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:36.076986 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:36.076975 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:40.076968824 +0000 UTC m=+264.950953986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : configmap "kube-rbac-proxy" not found Jul 02 14:05:36.175246 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:36.175217 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rskpz_73e481ff-00ad-4387-8681-b7a27251472a/serve-healthcheck-canary/0.log" Jul 02 14:05:40.101517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:40.101410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:40.101517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:40.101474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:40.101928 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:40.101555 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:05:40.101928 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:40.101561 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:05:40.101928 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:40.101617 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:48.101603047 +0000 UTC m=+272.975588210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : configmap "kube-rbac-proxy" not found Jul 02 14:05:40.101928 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:40.101630 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls podName:835bdb88-f038-42f2-ae8d-6c4070dfeea8 nodeName:}" failed. No retries permitted until 2026-07-02 14:05:48.101624174 +0000 UTC m=+272.975609336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-splww" (UID: "835bdb88-f038-42f2-ae8d-6c4070dfeea8") : secret "insights-runtime-extractor-tls" not found Jul 02 14:05:48.159737 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.159685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:48.160153 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.159759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:48.160327 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.160300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/835bdb88-f038-42f2-ae8d-6c4070dfeea8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:48.161962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.161943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/835bdb88-f038-42f2-ae8d-6c4070dfeea8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-splww\" (UID: \"835bdb88-f038-42f2-ae8d-6c4070dfeea8\") " pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:48.180995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.180952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-splww" Jul 02 14:05:48.318394 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.318361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-splww"] Jul 02 14:05:48.322374 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:05:48.322345 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835bdb88_f038_42f2_ae8d_6c4070dfeea8.slice/crio-3b968d680a4eae2cad292400d54a317e7a112af338075df74bd116cd54dba29f WatchSource:0}: Error finding container 3b968d680a4eae2cad292400d54a317e7a112af338075df74bd116cd54dba29f: Status 404 returned error can't find the container with id 3b968d680a4eae2cad292400d54a317e7a112af338075df74bd116cd54dba29f Jul 02 14:05:48.544035 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:48.544001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-splww" event={"ID":"835bdb88-f038-42f2-ae8d-6c4070dfeea8","Type":"ContainerStarted","Data":"3b968d680a4eae2cad292400d54a317e7a112af338075df74bd116cd54dba29f"} Jul 02 14:05:52.559910 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:52.559871 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-splww" event={"ID":"835bdb88-f038-42f2-ae8d-6c4070dfeea8","Type":"ContainerStarted","Data":"195f465309a161e997aa6e1b40997b9a3b2f773bc02bf31dea2158c0844e894f"} Jul 02 14:05:53.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:53.565326 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-splww" event={"ID":"835bdb88-f038-42f2-ae8d-6c4070dfeea8","Type":"ContainerStarted","Data":"866df576911d8b27caae04cde08e3a71ad17a3f58fa05189bea2309fd12748ad"} Jul 02 14:05:55.573624 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:55.573593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-splww" event={"ID":"835bdb88-f038-42f2-ae8d-6c4070dfeea8","Type":"ContainerStarted","Data":"2ea03bc6c9443d3597764312dde7cfa960c0981e38dd882d856c08d0600e460c"} Jul 02 14:05:55.613800 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:55.613745 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-splww" podStartSLOduration=16.78980718 podStartE2EDuration="23.613729611s" totalImagesPullingTime="6.823922431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:05:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:55.612900172 +0000 UTC m=+280.486885356" watchObservedRunningTime="2026-07-02 14:05:55.613729611 +0000 UTC m=+280.487714795" Jul 02 14:05:57.176636 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.176602 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d75b9f65d-96xr6"] Jul 02 14:05:57.179674 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.179658 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.187389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.187367 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 14:05:57.187459 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.187426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 14:05:57.188956 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.188940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tn8cj\"" Jul 02 14:05:57.189196 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.189181 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 14:05:57.203416 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.203365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 14:05:57.205265 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.205241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d75b9f65d-96xr6"] Jul 02 14:05:57.216318 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:05:57.216283 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8v9qr" podUID="468ce41d-4e3c-4e90-8bc7-b00bc2236367" Jul 02 14:05:57.230517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-bound-sa-token\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230599 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-ca-trust-extracted\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230599 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnkv\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-kube-api-access-wvnkv\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230693 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-certificates\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230693 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-image-registry-private-configuration\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230832 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-trusted-ca\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230832 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-installation-pull-secrets\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.230832 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.230748 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-tls\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.331776 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.331741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-certificates\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.331941 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.331787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-image-registry-private-configuration\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.331941 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.331852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-trusted-ca\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.331941 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.331897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-installation-pull-secrets\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332066 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-tls\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332158 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-bound-sa-token\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332212 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-ca-trust-extracted\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332261 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnkv\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-kube-api-access-wvnkv\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332739 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332685 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-ca-trust-extracted\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332739 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-certificates\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.332955 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.332927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-trusted-ca\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.334418 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.334395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-image-registry-private-configuration\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.334418 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.334401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-installation-pull-secrets\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.334553 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.334523 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-registry-tls\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.341604 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.341579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnkv\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-kube-api-access-wvnkv\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.343529 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.343509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16123c8-3171-41d3-ba1d-2fa2ebf7c49c-bound-sa-token\") pod \"image-registry-7d75b9f65d-96xr6\" (UID: \"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c\") " pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.488540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.488456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:05:57.584573 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.581244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:05:57.626517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:57.626488 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d75b9f65d-96xr6"] Jul 02 14:05:57.629414 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:05:57.629387 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16123c8_3171_41d3_ba1d_2fa2ebf7c49c.slice/crio-543d3184bce793aa94e95856b70ef07b077cdf23688d47cbdfcc1325b4f2b9d4 WatchSource:0}: Error finding container 543d3184bce793aa94e95856b70ef07b077cdf23688d47cbdfcc1325b4f2b9d4: Status 404 returned error can't find the container with id 543d3184bce793aa94e95856b70ef07b077cdf23688d47cbdfcc1325b4f2b9d4 Jul 02 14:05:58.585207 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:58.585171 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" event={"ID":"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c","Type":"ContainerStarted","Data":"48e2935c43a8304d33e8354c512451d7a4326a6597cca07efb31dfba992c2774"} Jul 02 14:05:58.585596 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:58.585225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" event={"ID":"a16123c8-3171-41d3-ba1d-2fa2ebf7c49c","Type":"ContainerStarted","Data":"543d3184bce793aa94e95856b70ef07b077cdf23688d47cbdfcc1325b4f2b9d4"} Jul 02 14:05:58.585596 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:05:58.585271 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:06:00.859304 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:00.859263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:06:00.861670 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:00.861647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/468ce41d-4e3c-4e90-8bc7-b00bc2236367-metrics-tls\") pod \"dns-default-8v9qr\" (UID: \"468ce41d-4e3c-4e90-8bc7-b00bc2236367\") " pod="openshift-dns/dns-default-8v9qr" Jul 02 14:06:00.885614 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:00.885587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h8n4j\"" Jul 02 14:06:00.892950 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:00.892932 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:06:01.017243 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:01.017190 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" podStartSLOduration=4.017170229 podStartE2EDuration="4.017170229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:05:58.634911831 +0000 UTC m=+283.508897015" watchObservedRunningTime="2026-07-02 14:06:01.017170229 +0000 UTC m=+285.891155413" Jul 02 14:06:01.017602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:01.017572 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8v9qr"] Jul 02 14:06:01.021055 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:06:01.021025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468ce41d_4e3c_4e90_8bc7_b00bc2236367.slice/crio-34f484daf418fa3537b6dcd75cdb5058c776bcb4b3b08ec457c1f886ccc2855d WatchSource:0}: Error finding container 34f484daf418fa3537b6dcd75cdb5058c776bcb4b3b08ec457c1f886ccc2855d: Status 404 returned error can't find the container with id 34f484daf418fa3537b6dcd75cdb5058c776bcb4b3b08ec457c1f886ccc2855d Jul 02 14:06:01.594177 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:01.594139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8v9qr" event={"ID":"468ce41d-4e3c-4e90-8bc7-b00bc2236367","Type":"ContainerStarted","Data":"34f484daf418fa3537b6dcd75cdb5058c776bcb4b3b08ec457c1f886ccc2855d"} Jul 02 14:06:03.602817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:03.602783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8v9qr" event={"ID":"468ce41d-4e3c-4e90-8bc7-b00bc2236367","Type":"ContainerStarted","Data":"4f8c3f65715bdb04d280bcfad026847fb9b5d84ef99060bad747aa226ad9d3c3"} Jul 02 14:06:03.603236 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:03.602833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8v9qr" event={"ID":"468ce41d-4e3c-4e90-8bc7-b00bc2236367","Type":"ContainerStarted","Data":"3d8d8248f7c0a7ae6a7753a0fcefe99832eabf5884d9c2329f8445c978b01631"} Jul 02 14:06:03.603236 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:03.602936 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:06:03.623317 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:03.623274 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8v9qr" podStartSLOduration=251.826768033 podStartE2EDuration="4m13.623259359s" totalImagesPullingTime="1.796491326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:03.621522862 +0000 UTC m=+288.495508047" watchObservedRunningTime="2026-07-02 14:06:03.623259359 +0000 UTC m=+288.497244542" Jul 02 14:06:08.586037 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:06:08.585979 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fmt8p" podUID="b9994a49-bec0-41c3-9b04-9f7873308707" Jul 02 14:06:10.074745 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.074711 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gvr4p"] Jul 02 14:06:10.077670 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.077651 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.080386 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.080351 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 14:06:10.080517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.080362 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 14:06:10.080517 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.080439 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 14:06:10.080709 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.080692 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r5gz6\"" Jul 02 14:06:10.080784 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.080739 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 14:06:10.081378 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.081362 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 14:06:10.081603 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.081589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 14:06:10.126746 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8bl6\" (UniqueName: \"kubernetes.io/projected/dc7ab275-f30a-4d7c-941b-a22621ead3fa-kube-api-access-t8bl6\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126746 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-sys\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126954 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-textfile\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126954 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-tls\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126954 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-metrics-client-ca\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126954 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.126954 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-wtmp\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.127136 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-root\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.127136 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.126994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227514 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-wtmp\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227514 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-root\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8bl6\" (UniqueName: \"kubernetes.io/projected/dc7ab275-f30a-4d7c-941b-a22621ead3fa-kube-api-access-t8bl6\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-sys\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-root\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-textfile\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-wtmp\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-tls\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7ab275-f30a-4d7c-941b-a22621ead3fa-sys\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.227759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-metrics-client-ca\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.228115 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.228115 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.227968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-textfile\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.228230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.228156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.228230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.228222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7ab275-f30a-4d7c-941b-a22621ead3fa-metrics-client-ca\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.230039 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.230018 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.230150 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.230100 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7ab275-f30a-4d7c-941b-a22621ead3fa-node-exporter-tls\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.238186 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.238161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8bl6\" (UniqueName: \"kubernetes.io/projected/dc7ab275-f30a-4d7c-941b-a22621ead3fa-kube-api-access-t8bl6\") pod \"node-exporter-gvr4p\" (UID: \"dc7ab275-f30a-4d7c-941b-a22621ead3fa\") " pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.386895 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.386805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvr4p" Jul 02 14:06:10.397101 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:06:10.397059 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7ab275_f30a_4d7c_941b_a22621ead3fa.slice/crio-3562e8b9b9c5f1bc6bc58b1b865bb047475adc8506ef2d80966b2d70959301ec WatchSource:0}: Error finding container 3562e8b9b9c5f1bc6bc58b1b865bb047475adc8506ef2d80966b2d70959301ec: Status 404 returned error can't find the container with id 3562e8b9b9c5f1bc6bc58b1b865bb047475adc8506ef2d80966b2d70959301ec Jul 02 14:06:10.624106 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:10.624053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvr4p" event={"ID":"dc7ab275-f30a-4d7c-941b-a22621ead3fa","Type":"ContainerStarted","Data":"3562e8b9b9c5f1bc6bc58b1b865bb047475adc8506ef2d80966b2d70959301ec"} Jul 02 14:06:12.632368 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:12.632332 2565 generic.go:356] "Generic (PLEG): container finished" podID="dc7ab275-f30a-4d7c-941b-a22621ead3fa" containerID="58a064408e6a3237050b85c3b7af3445b0d91b7ff4b7eff401d86bc02806e442" exitCode=0 Jul 02 14:06:12.632739 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:12.632382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvr4p" event={"ID":"dc7ab275-f30a-4d7c-941b-a22621ead3fa","Type":"ContainerDied","Data":"58a064408e6a3237050b85c3b7af3445b0d91b7ff4b7eff401d86bc02806e442"} Jul 02 14:06:13.607618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:13.607593 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8v9qr" Jul 02 14:06:13.646339 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:13.646304 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvr4p" event={"ID":"dc7ab275-f30a-4d7c-941b-a22621ead3fa","Type":"ContainerStarted","Data":"a5dd9dc79473e79433ca09e5c00aea8ca1f4ef001955cea213994816a308cd87"} Jul 02 14:06:13.646702 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:13.646390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvr4p" event={"ID":"dc7ab275-f30a-4d7c-941b-a22621ead3fa","Type":"ContainerStarted","Data":"45c76eed457794751e10c8e229ec97be9bbfdd9c25f0c7e2ceeffb7ac69adba3"} Jul 02 14:06:13.667815 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:13.667764 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gvr4p" podStartSLOduration=2.411877372 podStartE2EDuration="3.667749019s" totalImagesPullingTime="1.194480128s" totalInitContainerRuntime="61.391519ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:13.666742211 +0000 UTC m=+298.540727395" watchObservedRunningTime="2026-07-02 14:06:13.667749019 +0000 UTC m=+298.541734202" Jul 02 14:06:14.500550 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.500508 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-545cb4bcc9-8kxxh"] Jul 02 14:06:14.503703 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.503686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.507010 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.506989 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 14:06:14.507158 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.507140 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 14:06:14.507291 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.507271 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9mcbq\"" Jul 02 14:06:14.508246 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.508229 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 14:06:14.508349 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.508233 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6jefti2cfmafp\"" Jul 02 14:06:14.508349 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.508287 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 14:06:14.525703 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.525652 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545cb4bcc9-8kxxh"] Jul 02 14:06:14.565095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-tls\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565098 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-client-certs\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nclh\" (UniqueName: \"kubernetes.io/projected/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-kube-api-access-8nclh\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-audit-log\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-metrics-server-audit-profiles\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.565366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.565326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-client-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.666585 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-tls\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-client-certs\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nclh\" (UniqueName: \"kubernetes.io/projected/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-kube-api-access-8nclh\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-audit-log\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-metrics-server-audit-profiles\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.666835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-client-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667496 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.667477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-audit-log\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.667579 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.667535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.668222 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.668200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-metrics-server-audit-profiles\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.669364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.669316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-client-certs\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.669364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.669316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-secret-metrics-server-tls\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.669480 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.669449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-client-ca-bundle\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.685173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.685150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nclh\" (UniqueName: \"kubernetes.io/projected/7e20b464-dc22-4a65-af0a-7f49a7eb02a6-kube-api-access-8nclh\") pod \"metrics-server-545cb4bcc9-8kxxh\" (UID: \"7e20b464-dc22-4a65-af0a-7f49a7eb02a6\") " pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.812434 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.812400 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:14.938591 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:14.938511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-545cb4bcc9-8kxxh"] Jul 02 14:06:14.940553 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:06:14.940530 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e20b464_dc22_4a65_af0a_7f49a7eb02a6.slice/crio-e8e0ecc7f2cc8d1b250a1933b253ac810da2abb2fd22462e0f28f5c2c0b1d37c WatchSource:0}: Error finding container e8e0ecc7f2cc8d1b250a1933b253ac810da2abb2fd22462e0f28f5c2c0b1d37c: Status 404 returned error can't find the container with id e8e0ecc7f2cc8d1b250a1933b253ac810da2abb2fd22462e0f28f5c2c0b1d37c Jul 02 14:06:15.522507 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:15.522477 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:06:15.523653 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:15.523628 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:06:15.528380 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:15.528364 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 14:06:15.653328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:15.653297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" event={"ID":"7e20b464-dc22-4a65-af0a-7f49a7eb02a6","Type":"ContainerStarted","Data":"e8e0ecc7f2cc8d1b250a1933b253ac810da2abb2fd22462e0f28f5c2c0b1d37c"} Jul 02 14:06:16.203316 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.200068 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:06:16.205681 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.205643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.208483 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 14:06:16.208718 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208698 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 14:06:16.208859 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 14:06:16.208961 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 14:06:16.209143 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208787 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 14:06:16.209229 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.208815 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 14:06:16.209325 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.209310 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 14:06:16.209827 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.209807 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 14:06:16.210019 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.209902 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 14:06:16.210019 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mj9lrcne1uc9\"" Jul 02 14:06:16.210185 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 14:06:16.210253 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210230 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 14:06:16.210367 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210297 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 14:06:16.210525 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210510 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 14:06:16.210943 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.210923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcd2p\"" Jul 02 14:06:16.213053 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.212917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 14:06:16.232460 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.232427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:06:16.281879 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.281838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282060 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.281886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282060 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.281949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282060 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282269 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282269 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmk4\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282269 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282269 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282269 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282358 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.282698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.282568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383466 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383466 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmk4\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383724 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383724 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383724 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.383901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.383841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384249 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384322 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384381 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384381 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384475 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384475 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384475 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.384807 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.384745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.386983 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.385675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.386983 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.386401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.386983 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.386708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.386983 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.386913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.386983 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.386944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.387366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.387294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.387425 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.387404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.387481 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.387441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.387481 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.387465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.387741 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.387714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.388025 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.388000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.388849 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.388822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.389382 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.389338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.389479 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.389465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.389548 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.389531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.390680 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.390659 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.390901 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.390885 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.391386 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.391362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.392120 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.392100 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmk4\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4\") pod \"prometheus-k8s-0\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.518192 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.518113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:16.963230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:16.963090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:06:16.965292 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:06:16.965262 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c68a47e_286c_4ecb_8742_9601e23adc13.slice/crio-20cfece220a5138e4d7ae48ecca818d87b7dad9e28064a79c28ee23f32619e36 WatchSource:0}: Error finding container 20cfece220a5138e4d7ae48ecca818d87b7dad9e28064a79c28ee23f32619e36: Status 404 returned error can't find the container with id 20cfece220a5138e4d7ae48ecca818d87b7dad9e28064a79c28ee23f32619e36 Jul 02 14:06:17.661514 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:17.661478 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"20cfece220a5138e4d7ae48ecca818d87b7dad9e28064a79c28ee23f32619e36"} Jul 02 14:06:17.662927 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:17.662904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" event={"ID":"7e20b464-dc22-4a65-af0a-7f49a7eb02a6","Type":"ContainerStarted","Data":"c4960e63d0e16fe66d73c18ac2ca0f46890930fc683ca87aa63af9ae87ff273a"} Jul 02 14:06:17.682321 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:17.682273 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" podStartSLOduration=1.746736736 podStartE2EDuration="3.68225728s" totalImagesPullingTime="1.935520544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:17.681650608 +0000 UTC m=+302.555635791" watchObservedRunningTime="2026-07-02 14:06:17.68225728 +0000 UTC m=+302.556242464" Jul 02 14:06:18.667796 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:18.667760 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="c1718d52401b6e41586a47245e4ba53d558bebd2c067f25480ed412841f55f4c" exitCode=0 Jul 02 14:06:18.668188 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:18.667847 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"c1718d52401b6e41586a47245e4ba53d558bebd2c067f25480ed412841f55f4c"} Jul 02 14:06:18.669037 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:18.669024 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:06:19.581343 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:19.581311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:06:19.592610 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:19.592574 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d75b9f65d-96xr6" Jul 02 14:06:23.689422 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:23.689377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"191d0eda9e338a5cae231cf2a61030cd9069f5fddd09014bf5fd4f31a1be2997"} Jul 02 14:06:23.689794 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:23.689472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"3b438a89251fef9b35c019d2e50135fabc63dde81c879db21214b80e8380507d"} Jul 02 14:06:26.701228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:26.701192 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"1ba395eb05ce3ca8e8ab9308a57d3b14bcce4fade7e0b4ec7cdb62d904b099a8"} Jul 02 14:06:26.701617 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:26.701281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"94e107f36f3186258af8f61ad9fcb959fc781f230daebb8d4ea11e4d150fb42b"} Jul 02 14:06:26.701617 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:26.701310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"b73b415ff063a91c3d87e76849cbe04fe854a88509e6cc1e50b6d094f012d9ab"} Jul 02 14:06:26.701617 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:26.701334 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerStarted","Data":"8f079f8f757f890c09c440372253c958f76dce56291038768ab05f6fb4c81d58"} Jul 02 14:06:31.519275 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:31.519240 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:06:34.812989 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:34.812945 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:34.813383 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:34.813019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:46.666982 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:46.666937 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" podUID="e9ba4d42-a76d-442f-8290-18a06901ef5d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:06:54.818043 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:54.818013 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:54.821806 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:54.821786 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-545cb4bcc9-8kxxh" Jul 02 14:06:54.843164 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:54.843119 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=30.651216223 podStartE2EDuration="38.84307318s" totalImagesPullingTime="8.173767272s" totalInitContainerRuntime="18.089685ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:06:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:06:26.732386194 +0000 UTC m=+311.606371376" watchObservedRunningTime="2026-07-02 14:06:54.84307318 +0000 UTC m=+339.717058384" Jul 02 14:06:56.667275 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:06:56.667235 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" podUID="e9ba4d42-a76d-442f-8290-18a06901ef5d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:07:06.667554 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.667509 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" podUID="e9ba4d42-a76d-442f-8290-18a06901ef5d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:07:06.668018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.667581 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" Jul 02 14:07:06.668105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.668049 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8b6afcffe2b360afffde5fbf79aab5c3c3f772552c0e1f05bc0f1684f3ce3f01"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 02 14:07:06.668148 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.668126 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" podUID="e9ba4d42-a76d-442f-8290-18a06901ef5d" containerName="service-proxy" containerID="cri-o://8b6afcffe2b360afffde5fbf79aab5c3c3f772552c0e1f05bc0f1684f3ce3f01" gracePeriod=30 Jul 02 14:07:06.849830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.849801 2565 generic.go:356] "Generic (PLEG): container finished" podID="e9ba4d42-a76d-442f-8290-18a06901ef5d" containerID="8b6afcffe2b360afffde5fbf79aab5c3c3f772552c0e1f05bc0f1684f3ce3f01" exitCode=2 Jul 02 14:07:06.850096 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.849868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerDied","Data":"8b6afcffe2b360afffde5fbf79aab5c3c3f772552c0e1f05bc0f1684f3ce3f01"} Jul 02 14:07:06.850096 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:06.849910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc57b5fc9-qkh2r" event={"ID":"e9ba4d42-a76d-442f-8290-18a06901ef5d","Type":"ContainerStarted","Data":"2e241e2d66c0a6b2d5d23131cae26f9c866af902f1771799b49bdd118f6ae73c"} Jul 02 14:07:16.519298 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:16.519221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:16.537633 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:16.537610 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:16.896854 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:16.896822 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:28.887565 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:28.887525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:07:28.889823 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:28.889797 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9994a49-bec0-41c3-9b04-9f7873308707-metrics-certs\") pod \"network-metrics-daemon-fmt8p\" (UID: \"b9994a49-bec0-41c3-9b04-9f7873308707\") " pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:07:29.185013 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:29.184935 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c8jwt\"" Jul 02 14:07:29.192416 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:29.192389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmt8p" Jul 02 14:07:29.367367 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:29.367340 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmt8p"] Jul 02 14:07:29.369712 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:07:29.369681 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9994a49_bec0_41c3_9b04_9f7873308707.slice/crio-f98d0d161c857f2257639ed1ac6a06f0873eece19e43e2f9337d552141bd2f46 WatchSource:0}: Error finding container f98d0d161c857f2257639ed1ac6a06f0873eece19e43e2f9337d552141bd2f46: Status 404 returned error can't find the container with id f98d0d161c857f2257639ed1ac6a06f0873eece19e43e2f9337d552141bd2f46 Jul 02 14:07:29.927175 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:29.927131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmt8p" event={"ID":"b9994a49-bec0-41c3-9b04-9f7873308707","Type":"ContainerStarted","Data":"f98d0d161c857f2257639ed1ac6a06f0873eece19e43e2f9337d552141bd2f46"} Jul 02 14:07:30.932540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:30.932502 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmt8p" event={"ID":"b9994a49-bec0-41c3-9b04-9f7873308707","Type":"ContainerStarted","Data":"5aef262303165e658217a0e5f33bd135b060b7195da54484e783d900f9400152"} Jul 02 14:07:30.932940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:30.932583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmt8p" event={"ID":"b9994a49-bec0-41c3-9b04-9f7873308707","Type":"ContainerStarted","Data":"6bbe42a222544000e2dff5a79783eb7aaf7c7c7dcc9a8645d19c9272fe537bce"} Jul 02 14:07:30.952479 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:30.952426 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fmt8p" podStartSLOduration=374.107568279 podStartE2EDuration="6m14.952410406s" totalImagesPullingTime="844.842127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:07:30.951869678 +0000 UTC m=+375.825854861" watchObservedRunningTime="2026-07-02 14:07:30.952410406 +0000 UTC m=+375.826395589" Jul 02 14:07:34.800711 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.800676 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:34.801121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.800990 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="prometheus" containerID="cri-o://3b438a89251fef9b35c019d2e50135fabc63dde81c879db21214b80e8380507d" gracePeriod=600 Jul 02 14:07:34.801121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.801002 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy" containerID="cri-o://94e107f36f3186258af8f61ad9fcb959fc781f230daebb8d4ea11e4d150fb42b" gracePeriod=600 Jul 02 14:07:34.801121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.801038 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1ba395eb05ce3ca8e8ab9308a57d3b14bcce4fade7e0b4ec7cdb62d904b099a8" gracePeriod=600 Jul 02 14:07:34.801121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.801086 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="config-reloader" containerID="cri-o://191d0eda9e338a5cae231cf2a61030cd9069f5fddd09014bf5fd4f31a1be2997" gracePeriod=600 Jul 02 14:07:34.801121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.801069 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="thanos-sidecar" containerID="cri-o://8f079f8f757f890c09c440372253c958f76dce56291038768ab05f6fb4c81d58" gracePeriod=600 Jul 02 14:07:34.801438 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.801177 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-web" containerID="cri-o://b73b415ff063a91c3d87e76849cbe04fe854a88509e6cc1e50b6d094f012d9ab" gracePeriod=600 Jul 02 14:07:34.950105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950060 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="1ba395eb05ce3ca8e8ab9308a57d3b14bcce4fade7e0b4ec7cdb62d904b099a8" exitCode=0 Jul 02 14:07:34.950105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950099 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="94e107f36f3186258af8f61ad9fcb959fc781f230daebb8d4ea11e4d150fb42b" exitCode=0 Jul 02 14:07:34.950105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950108 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="b73b415ff063a91c3d87e76849cbe04fe854a88509e6cc1e50b6d094f012d9ab" exitCode=0 Jul 02 14:07:34.950105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950115 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="8f079f8f757f890c09c440372253c958f76dce56291038768ab05f6fb4c81d58" exitCode=0 Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"1ba395eb05ce3ca8e8ab9308a57d3b14bcce4fade7e0b4ec7cdb62d904b099a8"} Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"94e107f36f3186258af8f61ad9fcb959fc781f230daebb8d4ea11e4d150fb42b"} Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950123 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="191d0eda9e338a5cae231cf2a61030cd9069f5fddd09014bf5fd4f31a1be2997" exitCode=0 Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"b73b415ff063a91c3d87e76849cbe04fe854a88509e6cc1e50b6d094f012d9ab"} Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950212 2565 generic.go:356] "Generic (PLEG): container finished" podID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerID="3b438a89251fef9b35c019d2e50135fabc63dde81c879db21214b80e8380507d" exitCode=0 Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"8f079f8f757f890c09c440372253c958f76dce56291038768ab05f6fb4c81d58"} Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"191d0eda9e338a5cae231cf2a61030cd9069f5fddd09014bf5fd4f31a1be2997"} Jul 02 14:07:34.950369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:34.950279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"3b438a89251fef9b35c019d2e50135fabc63dde81c879db21214b80e8380507d"} Jul 02 14:07:35.044254 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.044228 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:35.133111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133007 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwmk4\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133056 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133105 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133137 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133171 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133199 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133224 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133266 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133290 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133318 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133343 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133383 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133410 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133439 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133487 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133510 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133535 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133572 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133603 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133616 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.133742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133688 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls\") pod \"8c68a47e-286c-4ecb-8742-9601e23adc13\" (UID: \"8c68a47e-286c-4ecb-8742-9601e23adc13\") " Jul 02 14:07:35.134246 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.133971 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.135508 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.134367 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:07:35.135508 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.134950 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.135508 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.134975 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.135768 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.135533 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.135768 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.135636 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.136526 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.136491 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.137025 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.136987 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:07:35.138585 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138542 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:07:35.138667 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138613 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138732 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138672 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138830 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138840 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138861 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config" (OuterVolumeSpecName: "config") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138884 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138895 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.138919 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.138890 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4" (OuterVolumeSpecName: "kube-api-access-pwmk4") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "kube-api-access-pwmk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:07:35.139163 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.139129 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out" (OuterVolumeSpecName: "config-out") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:07:35.139342 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.139322 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.147670 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.147642 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config" (OuterVolumeSpecName: "web-config") pod "8c68a47e-286c-4ecb-8742-9601e23adc13" (UID: "8c68a47e-286c-4ecb-8742-9601e23adc13"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:07:35.235188 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235143 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-grpc-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235188 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235184 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwmk4\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-kube-api-access-pwmk4\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235188 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235194 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-db\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235206 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235215 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235223 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-metrics-client-certs\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235232 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235241 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235249 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-kube-rbac-proxy\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235257 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c68a47e-286c-4ecb-8742-9601e23adc13-config-out\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235264 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235272 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-metrics-client-ca\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235280 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235290 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235298 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-web-config\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235305 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c68a47e-286c-4ecb-8742-9601e23adc13-tls-assets\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235313 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8c68a47e-286c-4ecb-8742-9601e23adc13-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235321 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.235391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.235334 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8c68a47e-286c-4ecb-8742-9601e23adc13-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:07:35.956422 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.956337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8c68a47e-286c-4ecb-8742-9601e23adc13","Type":"ContainerDied","Data":"20cfece220a5138e4d7ae48ecca818d87b7dad9e28064a79c28ee23f32619e36"} Jul 02 14:07:35.956422 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.956403 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:35.956862 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.956438 2565 scope.go:117] "RemoveContainer" containerID="1ba395eb05ce3ca8e8ab9308a57d3b14bcce4fade7e0b4ec7cdb62d904b099a8" Jul 02 14:07:35.964068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.964051 2565 scope.go:117] "RemoveContainer" containerID="94e107f36f3186258af8f61ad9fcb959fc781f230daebb8d4ea11e4d150fb42b" Jul 02 14:07:35.970827 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.970810 2565 scope.go:117] "RemoveContainer" containerID="b73b415ff063a91c3d87e76849cbe04fe854a88509e6cc1e50b6d094f012d9ab" Jul 02 14:07:35.979531 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.979510 2565 scope.go:117] "RemoveContainer" containerID="8f079f8f757f890c09c440372253c958f76dce56291038768ab05f6fb4c81d58" Jul 02 14:07:35.979990 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.979972 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:35.986166 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.986104 2565 scope.go:117] "RemoveContainer" containerID="191d0eda9e338a5cae231cf2a61030cd9069f5fddd09014bf5fd4f31a1be2997" Jul 02 14:07:35.988089 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.988059 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:35.993020 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:35.992986 2565 scope.go:117] "RemoveContainer" containerID="3b438a89251fef9b35c019d2e50135fabc63dde81c879db21214b80e8380507d" Jul 02 14:07:36.000022 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.000004 2565 scope.go:117] "RemoveContainer" containerID="c1718d52401b6e41586a47245e4ba53d558bebd2c067f25480ed412841f55f4c" Jul 02 14:07:36.015607 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015581 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:36.015817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015805 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-thanos" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015818 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-thanos" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015834 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="thanos-sidecar" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015840 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="thanos-sidecar" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015846 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015851 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015860 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="init-config-reloader" Jul 02 14:07:36.015870 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015865 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="init-config-reloader" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015878 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="config-reloader" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015883 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="config-reloader" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015888 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-web" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015893 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-web" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015901 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="prometheus" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015906 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="prometheus" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015946 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015953 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="prometheus" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015958 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-thanos" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015964 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="config-reloader" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015969 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="thanos-sidecar" Jul 02 14:07:36.016068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.015974 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" containerName="kube-rbac-proxy-web" Jul 02 14:07:36.020531 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.020514 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.023217 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023196 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 14:07:36.023217 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023220 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 14:07:36.023477 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 14:07:36.023550 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023488 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 14:07:36.023550 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 14:07:36.023644 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023621 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 14:07:36.023724 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023697 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcd2p\"" Jul 02 14:07:36.023848 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023797 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 14:07:36.023978 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.023963 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 14:07:36.024063 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.024048 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1mj9lrcne1uc9\"" Jul 02 14:07:36.024252 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.024238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 14:07:36.024320 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.024306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 14:07:36.024373 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.024336 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 14:07:36.024373 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.024306 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 14:07:36.027672 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.027556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 14:07:36.030674 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.030651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 14:07:36.037141 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.037118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:36.042283 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk69z\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-kube-api-access-qk69z\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042331 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.042750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.042729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143553 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143553 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk69z\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-kube-api-access-qk69z\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.143822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143703 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.143988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.144370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.145014 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.145014 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.145014 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.144447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146190 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146886 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.146948 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.146916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.147059 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.147037 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.147885 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.147810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.147885 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.147817 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.148053 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.147969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.148515 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.148485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.148904 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.148883 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.149253 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.149234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.149620 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.149600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f3f356f-eaee-4769-9b13-9687e6164a9e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.149851 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.149831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.150133 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.150117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f3f356f-eaee-4769-9b13-9687e6164a9e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.150509 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.150493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f3f356f-eaee-4769-9b13-9687e6164a9e-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.152571 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.152552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk69z\" (UniqueName: \"kubernetes.io/projected/0f3f356f-eaee-4769-9b13-9687e6164a9e-kube-api-access-qk69z\") pod \"prometheus-k8s-0\" (UID: \"0f3f356f-eaee-4769-9b13-9687e6164a9e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.330767 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.330727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:07:36.467121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.467041 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:07:36.469638 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:07:36.469610 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3f356f_eaee_4769_9b13_9687e6164a9e.slice/crio-beef7669a5aa8e39ef23ef4047d81b3697e5f0962794c28d334cf5bf66a70411 WatchSource:0}: Error finding container beef7669a5aa8e39ef23ef4047d81b3697e5f0962794c28d334cf5bf66a70411: Status 404 returned error can't find the container with id beef7669a5aa8e39ef23ef4047d81b3697e5f0962794c28d334cf5bf66a70411 Jul 02 14:07:36.962241 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.962203 2565 generic.go:356] "Generic (PLEG): container finished" podID="0f3f356f-eaee-4769-9b13-9687e6164a9e" containerID="16aa32ce934cd3f1989c5fd16352358b2c0100050ef3141ce164b461ed11ba72" exitCode=0 Jul 02 14:07:36.962649 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.962285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerDied","Data":"16aa32ce934cd3f1989c5fd16352358b2c0100050ef3141ce164b461ed11ba72"} Jul 02 14:07:36.962649 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:36.962348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"beef7669a5aa8e39ef23ef4047d81b3697e5f0962794c28d334cf5bf66a70411"} Jul 02 14:07:37.586201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.586166 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c68a47e-286c-4ecb-8742-9601e23adc13" path="/var/lib/kubelet/pods/8c68a47e-286c-4ecb-8742-9601e23adc13/volumes" Jul 02 14:07:37.969139 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"069eec30e9f7b4d3ee26241a2684cb2fa9bb6eb812c963b18bc509f1c29763cd"} Jul 02 14:07:37.969139 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"e8d8ab022697efa43783b6c5547e68445a5238e4dbba176c33774209e0df514b"} Jul 02 14:07:37.969534 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"efcecef2a87ac956f252258cca69c4489324361c51ec4058ca03e8c6af6892d7"} Jul 02 14:07:37.969534 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969194 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"2f91bbd3bc32ca75430a6a02dd1f4839432a650ef9d49c6be962388a8a357671"} Jul 02 14:07:37.969534 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"4326f8590a2d2f75340419c76e1812c719c9e5f8039e76bb9e8e14a245cca1cb"} Jul 02 14:07:37.969534 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:37.969245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f3f356f-eaee-4769-9b13-9687e6164a9e","Type":"ContainerStarted","Data":"ec9bc2d25b50088cb49f17e353d4d3869dc1f091959f9f35315ea6364588fca6"} Jul 02 14:07:38.008304 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:38.008250 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.986964611 podStartE2EDuration="3.008231996s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.267385ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:07:38.005462524 +0000 UTC m=+382.879447707" watchObservedRunningTime="2026-07-02 14:07:38.008231996 +0000 UTC m=+382.882217185" Jul 02 14:07:41.331751 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:07:41.331711 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:08:36.331627 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:08:36.331585 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:08:36.347232 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:08:36.347209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:08:37.195868 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:08:37.195843 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:09:35.257422 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.257390 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm"] Jul 02 14:09:35.260680 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.260658 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.268332 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.268303 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 14:09:35.268455 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.268388 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 14:09:35.268571 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.268557 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 14:09:35.269591 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.269577 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 14:09:35.269732 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.269717 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-95wkf\"" Jul 02 14:09:35.317834 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.317798 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm"] Jul 02 14:09:35.385540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.385512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.385718 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.385545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.385718 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.385568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.385718 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.385681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwtp\" (UniqueName: \"kubernetes.io/projected/224ca35c-128f-4167-8ab1-e42580e950fa-kube-api-access-lrwtp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.385817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.385719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486203 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486203 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486411 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486411 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwtp\" (UniqueName: \"kubernetes.io/projected/224ca35c-128f-4167-8ab1-e42580e950fa-kube-api-access-lrwtp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486411 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.486657 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.486630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-manifests\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.488622 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.488596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/224ca35c-128f-4167-8ab1-e42580e950fa-tmp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.488736 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.488713 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.488791 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.488776 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/224ca35c-128f-4167-8ab1-e42580e950fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.499409 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.499383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwtp\" (UniqueName: \"kubernetes.io/projected/224ca35c-128f-4167-8ab1-e42580e950fa-kube-api-access-lrwtp\") pod \"opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm\" (UID: \"224ca35c-128f-4167-8ab1-e42580e950fa\") " pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.570423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.570394 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:35.724871 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:35.724829 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm"] Jul 02 14:09:35.727779 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:09:35.727746 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224ca35c_128f_4167_8ab1_e42580e950fa.slice/crio-13994bd098692a6dc19d217f02d0da6427491f050a75ca3339ee98e2fdd823a3 WatchSource:0}: Error finding container 13994bd098692a6dc19d217f02d0da6427491f050a75ca3339ee98e2fdd823a3: Status 404 returned error can't find the container with id 13994bd098692a6dc19d217f02d0da6427491f050a75ca3339ee98e2fdd823a3 Jul 02 14:09:36.386421 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:36.386386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" event={"ID":"224ca35c-128f-4167-8ab1-e42580e950fa","Type":"ContainerStarted","Data":"13994bd098692a6dc19d217f02d0da6427491f050a75ca3339ee98e2fdd823a3"} Jul 02 14:09:40.403382 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:40.403345 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" event={"ID":"224ca35c-128f-4167-8ab1-e42580e950fa","Type":"ContainerStarted","Data":"289db07f0501337a898b07e59116952aa173b0c6081a81aa92ad81ef1f9ccb11"} Jul 02 14:09:41.407956 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:41.407920 2565 generic.go:356] "Generic (PLEG): container finished" podID="224ca35c-128f-4167-8ab1-e42580e950fa" containerID="289db07f0501337a898b07e59116952aa173b0c6081a81aa92ad81ef1f9ccb11" exitCode=0 Jul 02 14:09:41.408420 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:41.408013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" event={"ID":"224ca35c-128f-4167-8ab1-e42580e950fa","Type":"ContainerDied","Data":"289db07f0501337a898b07e59116952aa173b0c6081a81aa92ad81ef1f9ccb11"} Jul 02 14:09:42.414219 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:42.414179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" event={"ID":"224ca35c-128f-4167-8ab1-e42580e950fa","Type":"ContainerStarted","Data":"876bc63688c1e751685cd0b22ff7c15a90ee84a342a57ca782a6acddc7d78fc8"} Jul 02 14:09:42.414602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:42.414260 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:42.459213 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:42.459166 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" podStartSLOduration=1.8282699820000001 podStartE2EDuration="7.459150978s" totalImagesPullingTime="4.61489959s" totalInitContainerRuntime="1.015981406s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:09:42.457195153 +0000 UTC m=+507.331180329" watchObservedRunningTime="2026-07-02 14:09:42.459150978 +0000 UTC m=+507.333136161" Jul 02 14:09:53.420287 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:53.420257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm" Jul 02 14:09:57.438025 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.437988 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqgkp"] Jul 02 14:09:57.447618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.447598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:57.448387 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.448366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c444j\" (UniqueName: \"kubernetes.io/projected/3a2b11f9-7068-443d-a7b6-ac96b1d31310-kube-api-access-c444j\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:57.448460 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.448394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:57.453189 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.453171 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r6rh6\"" Jul 02 14:09:57.453803 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.453680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 14:09:57.465317 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.465294 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqgkp"] Jul 02 14:09:57.548835 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.548803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c444j\" (UniqueName: \"kubernetes.io/projected/3a2b11f9-7068-443d-a7b6-ac96b1d31310-kube-api-access-c444j\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:57.548835 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.548837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:57.549073 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:09:57.548951 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 14:09:57.549073 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:09:57.549013 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert podName:3a2b11f9-7068-443d-a7b6-ac96b1d31310 nodeName:}" failed. No retries permitted until 2026-07-02 14:09:58.04899674 +0000 UTC m=+522.922981908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert") pod "odh-model-controller-7998c67dc4-kqgkp" (UID: "3a2b11f9-7068-443d-a7b6-ac96b1d31310") : secret "odh-model-controller-webhook-cert" not found Jul 02 14:09:57.573736 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:57.573703 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c444j\" (UniqueName: \"kubernetes.io/projected/3a2b11f9-7068-443d-a7b6-ac96b1d31310-kube-api-access-c444j\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:58.051574 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:58.051539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:58.053959 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:58.053934 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a2b11f9-7068-443d-a7b6-ac96b1d31310-cert\") pod \"odh-model-controller-7998c67dc4-kqgkp\" (UID: \"3a2b11f9-7068-443d-a7b6-ac96b1d31310\") " pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:58.056810 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:58.056793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:09:58.212461 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:58.212429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kqgkp"] Jul 02 14:09:58.215548 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:09:58.215516 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2b11f9_7068_443d_a7b6_ac96b1d31310.slice/crio-f4dac82b82a36803069b41bfd6b30287923fd283be4a5908ae75fc3d0541dcca WatchSource:0}: Error finding container f4dac82b82a36803069b41bfd6b30287923fd283be4a5908ae75fc3d0541dcca: Status 404 returned error can't find the container with id f4dac82b82a36803069b41bfd6b30287923fd283be4a5908ae75fc3d0541dcca Jul 02 14:09:58.469681 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:58.469601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" event={"ID":"3a2b11f9-7068-443d-a7b6-ac96b1d31310","Type":"ContainerStarted","Data":"f4dac82b82a36803069b41bfd6b30287923fd283be4a5908ae75fc3d0541dcca"} Jul 02 14:09:59.090548 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.090517 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6"] Jul 02 14:09:59.093846 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.093830 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.102346 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.102322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 14:09:59.102469 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.102331 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 14:09:59.106227 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.106211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 14:09:59.108050 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.108035 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 14:09:59.143932 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.143902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6"] Jul 02 14:09:59.159244 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.159217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tls-certs\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.159411 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.159259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tmp\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.159411 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.159275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkrc5\" (UniqueName: \"kubernetes.io/projected/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-kube-api-access-kkrc5\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.215894 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.215852 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rvqd"] Jul 02 14:09:59.220774 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.220748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.251516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.251487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kqnv6\"" Jul 02 14:09:59.251516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.251483 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 14:09:59.259697 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.259674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tls-certs\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.259830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.259707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd551e39-b49c-4a86-95c4-ada41a8bce2e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.259830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.259737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tmp\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.259830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.259755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkrc5\" (UniqueName: \"kubernetes.io/projected/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-kube-api-access-kkrc5\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.259943 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.259870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x79w2\" (UniqueName: \"kubernetes.io/projected/dd551e39-b49c-4a86-95c4-ada41a8bce2e-kube-api-access-x79w2\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.262041 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.262015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tmp\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.262316 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.262296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-tls-certs\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.274274 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.274249 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkrc5\" (UniqueName: \"kubernetes.io/projected/7ba9e650-5a3c-4ba0-9af1-ca81327733ee-kube-api-access-kkrc5\") pod \"kube-auth-proxy-65f79d99c4-2xxq6\" (UID: \"7ba9e650-5a3c-4ba0-9af1-ca81327733ee\") " pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.285245 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.285214 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rvqd"] Jul 02 14:09:59.360336 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.360249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x79w2\" (UniqueName: \"kubernetes.io/projected/dd551e39-b49c-4a86-95c4-ada41a8bce2e-kube-api-access-x79w2\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.360336 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.360302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd551e39-b49c-4a86-95c4-ada41a8bce2e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.362771 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.362747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd551e39-b49c-4a86-95c4-ada41a8bce2e-tls-certs\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.382527 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.382498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x79w2\" (UniqueName: \"kubernetes.io/projected/dd551e39-b49c-4a86-95c4-ada41a8bce2e-kube-api-access-x79w2\") pod \"model-serving-api-54d89bd5fc-2rvqd\" (UID: \"dd551e39-b49c-4a86-95c4-ada41a8bce2e\") " pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.403364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.403341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" Jul 02 14:09:59.530578 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.530541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:09:59.539516 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.539448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6"] Jul 02 14:09:59.541676 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:09:59.541645 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba9e650_5a3c_4ba0_9af1_ca81327733ee.slice/crio-08d274982c702351c790278551c870a9bb25296597b8b898a1f0d7e9c6841850 WatchSource:0}: Error finding container 08d274982c702351c790278551c870a9bb25296597b8b898a1f0d7e9c6841850: Status 404 returned error can't find the container with id 08d274982c702351c790278551c870a9bb25296597b8b898a1f0d7e9c6841850 Jul 02 14:09:59.680803 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:09:59.680719 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2rvqd"] Jul 02 14:09:59.683772 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:09:59.683745 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd551e39_b49c_4a86_95c4_ada41a8bce2e.slice/crio-f488e05628955ececd2f76a8e0a5993d4f715e60e17cfd88ac93f93bb3bb41d0 WatchSource:0}: Error finding container f488e05628955ececd2f76a8e0a5993d4f715e60e17cfd88ac93f93bb3bb41d0: Status 404 returned error can't find the container with id f488e05628955ececd2f76a8e0a5993d4f715e60e17cfd88ac93f93bb3bb41d0 Jul 02 14:10:00.480692 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:00.480657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" event={"ID":"dd551e39-b49c-4a86-95c4-ada41a8bce2e","Type":"ContainerStarted","Data":"f488e05628955ececd2f76a8e0a5993d4f715e60e17cfd88ac93f93bb3bb41d0"} Jul 02 14:10:00.482217 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:00.482160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" event={"ID":"7ba9e650-5a3c-4ba0-9af1-ca81327733ee","Type":"ContainerStarted","Data":"08d274982c702351c790278551c870a9bb25296597b8b898a1f0d7e9c6841850"} Jul 02 14:10:01.598861 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.598686 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:01.603735 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.603643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.611744 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.611719 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 14:10:01.612355 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.612279 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 14:10:01.612355 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.612279 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 14:10:01.612552 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.612296 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 14:10:01.612926 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.612903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vrkzr\"" Jul 02 14:10:01.651284 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.651250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:01.674318 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69d4r\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.674758 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.674549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775219 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69d4r\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.775389 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.775379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.776128 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.776090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.777684 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.777662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.777960 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.777937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.778013 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.777937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.778155 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.778136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.785405 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.785381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.791458 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.791425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69d4r\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r\") pod \"istiod-openshift-gateway-7574459656-k6zcg\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:01.917822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:01.917732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:03.183539 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.183497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:03.497247 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.497204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" event={"ID":"3a2b11f9-7068-443d-a7b6-ac96b1d31310","Type":"ContainerStarted","Data":"a98e0a6d984803928af9cdd76967d0cc352d51b50495a6d2b68b2058621117a4"} Jul 02 14:10:03.497505 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.497314 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:10:03.499740 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.499711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" event={"ID":"dd551e39-b49c-4a86-95c4-ada41a8bce2e","Type":"ContainerStarted","Data":"a07e52753e16f963dfb6a01eacf42cdf2af9cfbcd2358fd5371c2b86830fdb42"} Jul 02 14:10:03.499873 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.499840 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:10:03.545540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.545480 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" podStartSLOduration=1.684932133 podStartE2EDuration="6.545460044s" totalImagesPullingTime="4.860527911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:03.544893269 +0000 UTC m=+528.418878452" watchObservedRunningTime="2026-07-02 14:10:03.545460044 +0000 UTC m=+528.419445228" Jul 02 14:10:03.607805 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:03.607735 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" podStartSLOduration=1.2762529630000001 podStartE2EDuration="4.607714698s" totalImagesPullingTime="3.331461735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:03.606671883 +0000 UTC m=+528.480657068" watchObservedRunningTime="2026-07-02 14:10:03.607714698 +0000 UTC m=+528.481699882" Jul 02 14:10:03.769577 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:10:03.769502 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aca718_e62b_4406_b8e4_10a6fd97b84b.slice/crio-df7f7089de6597a9db2ea1565fcccb66dbb4cc0541efd60f47c183a434245f9b WatchSource:0}: Error finding container df7f7089de6597a9db2ea1565fcccb66dbb4cc0541efd60f47c183a434245f9b: Status 404 returned error can't find the container with id df7f7089de6597a9db2ea1565fcccb66dbb4cc0541efd60f47c183a434245f9b Jul 02 14:10:04.505236 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:04.505194 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" event={"ID":"7ba9e650-5a3c-4ba0-9af1-ca81327733ee","Type":"ContainerStarted","Data":"59ff5cae5db4e1509400374f86a9d9cc8630facb636eeb391beea772801cb08d"} Jul 02 14:10:04.506433 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:04.506406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" event={"ID":"29aca718-e62b-4406-b8e4-10a6fd97b84b","Type":"ContainerStarted","Data":"df7f7089de6597a9db2ea1565fcccb66dbb4cc0541efd60f47c183a434245f9b"} Jul 02 14:10:04.534469 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:04.534418 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65f79d99c4-2xxq6" podStartSLOduration=2.253657915 podStartE2EDuration="6.534401749s" totalImagesPullingTime="4.280743834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:04.532949061 +0000 UTC m=+529.406934246" watchObservedRunningTime="2026-07-02 14:10:04.534401749 +0000 UTC m=+529.408386933" Jul 02 14:10:07.610313 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:07.610275 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:07.610603 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:07.610341 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:08.523122 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:08.523087 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" event={"ID":"29aca718-e62b-4406-b8e4-10a6fd97b84b","Type":"ContainerStarted","Data":"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db"} Jul 02 14:10:08.523278 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:08.523146 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:08.525159 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:08.525132 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k6zcg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 14:10:08.525276 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:08.525198 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:10:09.527948 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:09.527915 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k6zcg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 14:10:09.528444 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:09.527983 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:10:10.059318 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.059258 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" podStartSLOduration=5.220788657 podStartE2EDuration="9.059241357s" totalImagesPullingTime="3.8384527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:08.635833001 +0000 UTC m=+533.509818185" watchObservedRunningTime="2026-07-02 14:10:10.059241357 +0000 UTC m=+534.933226593" Jul 02 14:10:10.060157 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.060139 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6"] Jul 02 14:10:10.063265 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.063242 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.067846 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.067827 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 14:10:10.068556 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.068537 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vr8px\"" Jul 02 14:10:10.106795 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.106768 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6"] Jul 02 14:10:10.153946 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.153904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4jxd\" (UniqueName: \"kubernetes.io/projected/ba4a744d-d808-4611-9113-af8777867583-kube-api-access-x4jxd\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.154184 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.154037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4a744d-d808-4611-9113-af8777867583-cert\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.254742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.254706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4a744d-d808-4611-9113-af8777867583-cert\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.254929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.254760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4jxd\" (UniqueName: \"kubernetes.io/projected/ba4a744d-d808-4611-9113-af8777867583-kube-api-access-x4jxd\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.257194 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.257171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba4a744d-d808-4611-9113-af8777867583-cert\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.277022 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.276986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4jxd\" (UniqueName: \"kubernetes.io/projected/ba4a744d-d808-4611-9113-af8777867583-kube-api-access-x4jxd\") pod \"kserve-controller-manager-d6f4b65b8-8cgl6\" (UID: \"ba4a744d-d808-4611-9113-af8777867583\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.374300 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.374213 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:10.436665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.436628 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f"] Jul 02 14:10:10.440415 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.440391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.443923 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.443878 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pxmtd\"" Jul 02 14:10:10.460060 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.459862 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f"] Jul 02 14:10:10.543631 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.543607 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6"] Jul 02 14:10:10.545643 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:10:10.545615 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4a744d_d808_4611_9113_af8777867583.slice/crio-b7fee88c3e4d1ced7c48263cd3e8b81b3394219dbbad92ec399f242b3f287f77 WatchSource:0}: Error finding container b7fee88c3e4d1ced7c48263cd3e8b81b3394219dbbad92ec399f242b3f287f77: Status 404 returned error can't find the container with id b7fee88c3e4d1ced7c48263cd3e8b81b3394219dbbad92ec399f242b3f287f77 Jul 02 14:10:10.557201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557327 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557327 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e356078a-15ce-4b56-9940-f57cf265a9c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557469 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557469 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgvzn\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-kube-api-access-vgvzn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557469 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557594 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557594 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.557594 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.557529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.658882 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.658882 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.658882 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.658882 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e356078a-15ce-4b56-9940-f57cf265a9c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.658984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgvzn\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-kube-api-access-vgvzn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659473 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659473 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659473 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659387 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659608 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.659968 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.659946 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e356078a-15ce-4b56-9940-f57cf265a9c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.661373 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.661351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.661561 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.661543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.672909 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.672880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.696889 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.696865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgvzn\" (UniqueName: \"kubernetes.io/projected/e356078a-15ce-4b56-9940-f57cf265a9c4-kube-api-access-vgvzn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c7l4f\" (UID: \"e356078a-15ce-4b56-9940-f57cf265a9c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.751281 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.751245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:10.904355 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:10.904321 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f"] Jul 02 14:10:10.907844 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:10:10.907817 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode356078a_15ce_4b56_9940_f57cf265a9c4.slice/crio-fe77aa6741ba48adebf96f76458a8bf758828389abca2174354fbd9380494b45 WatchSource:0}: Error finding container fe77aa6741ba48adebf96f76458a8bf758828389abca2174354fbd9380494b45: Status 404 returned error can't find the container with id fe77aa6741ba48adebf96f76458a8bf758828389abca2174354fbd9380494b45 Jul 02 14:10:11.540503 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:11.540445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" event={"ID":"e356078a-15ce-4b56-9940-f57cf265a9c4","Type":"ContainerStarted","Data":"fe77aa6741ba48adebf96f76458a8bf758828389abca2174354fbd9380494b45"} Jul 02 14:10:11.541899 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:11.541836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" event={"ID":"ba4a744d-d808-4611-9113-af8777867583","Type":"ContainerStarted","Data":"b7fee88c3e4d1ced7c48263cd3e8b81b3394219dbbad92ec399f242b3f287f77"} Jul 02 14:10:12.528947 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:12.528916 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:13.217100 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.217051 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:13.217271 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.217243 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" containerID="cri-o://acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db" gracePeriod=30 Jul 02 14:10:13.429997 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.429963 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:13.430116 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.430040 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:13.430116 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.430068 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:10:13.510866 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.510842 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:13.553341 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.553306 2565 generic.go:356] "Generic (PLEG): container finished" podID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerID="acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db" exitCode=0 Jul 02 14:10:13.553783 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.553348 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" Jul 02 14:10:13.553783 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.553395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" event={"ID":"29aca718-e62b-4406-b8e4-10a6fd97b84b","Type":"ContainerDied","Data":"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db"} Jul 02 14:10:13.553783 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.553449 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg" event={"ID":"29aca718-e62b-4406-b8e4-10a6fd97b84b","Type":"ContainerDied","Data":"df7f7089de6597a9db2ea1565fcccb66dbb4cc0541efd60f47c183a434245f9b"} Jul 02 14:10:13.553783 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.553476 2565 scope.go:117] "RemoveContainer" containerID="acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db" Jul 02 14:10:13.555031 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.555011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" event={"ID":"e356078a-15ce-4b56-9940-f57cf265a9c4","Type":"ContainerStarted","Data":"e3b32e9b6b703c6928efa447625b308e9f190ea08024ab1810c427ea810a8efc"} Jul 02 14:10:13.563448 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.563426 2565 scope.go:117] "RemoveContainer" containerID="acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db" Jul 02 14:10:13.563748 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:10:13.563726 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db\": container with ID starting with acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db not found: ID does not exist" containerID="acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db" Jul 02 14:10:13.563817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.563759 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db"} err="failed to get container status \"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db\": rpc error: code = NotFound desc = could not find container \"acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db\": container with ID starting with acca53eb997db6ed1036b2a8bba8dd60575dadfbe5ad1700d2a1adcdcfa082db not found: ID does not exist" Jul 02 14:10:13.587033 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.586988 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587033 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587480 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587458 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587576 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587515 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587576 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587555 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587676 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587605 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.587676 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.587629 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69d4r\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r\") pod \"29aca718-e62b-4406-b8e4-10a6fd97b84b\" (UID: \"29aca718-e62b-4406-b8e4-10a6fd97b84b\") " Jul 02 14:10:13.589323 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.588698 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:10:13.590944 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.590914 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:10:13.591188 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.591161 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:10:13.591282 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.591240 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts" (OuterVolumeSpecName: "cacerts") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:10:13.591486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.591464 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token" (OuterVolumeSpecName: "istio-token") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:10:13.591751 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.591732 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r" (OuterVolumeSpecName: "kube-api-access-69d4r") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "kube-api-access-69d4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:10:13.592797 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.592771 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs" (OuterVolumeSpecName: "local-certs") pod "29aca718-e62b-4406-b8e4-10a6fd97b84b" (UID: "29aca718-e62b-4406-b8e4-10a6fd97b84b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:10:13.688911 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.688868 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29aca718-e62b-4406-b8e4-10a6fd97b84b-local-certs\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.688911 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.688895 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-ca-configmap\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.689095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.688978 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69d4r\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-kube-api-access-69d4r\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.689095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.688992 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-csr-dns-cert\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.689095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.689004 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-kubeconfig\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.689095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.689012 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29aca718-e62b-4406-b8e4-10a6fd97b84b-cacerts\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.689095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.689021 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29aca718-e62b-4406-b8e4-10a6fd97b84b-istio-token\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:10:13.752025 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.751937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:13.879704 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.879656 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" podStartSLOduration=1.359955689 podStartE2EDuration="3.879638551s" totalImagesPullingTime="2.519682862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:13.696861459 +0000 UTC m=+538.570846637" watchObservedRunningTime="2026-07-02 14:10:13.879638551 +0000 UTC m=+538.753623735" Jul 02 14:10:13.879945 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.879932 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:13.888204 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:13.888180 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k6zcg"] Jul 02 14:10:14.509017 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:14.508988 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kqgkp" Jul 02 14:10:14.511041 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:14.511026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2rvqd" Jul 02 14:10:14.757677 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:14.757650 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:15.567214 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:15.567173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" event={"ID":"ba4a744d-d808-4611-9113-af8777867583","Type":"ContainerStarted","Data":"a319e29ce8c8f54cfb39c366e90dc01a3d3c96603b88714dcd21ce0818c474db"} Jul 02 14:10:15.567361 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:15.567342 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:15.568404 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:15.568378 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c7l4f" Jul 02 14:10:15.586431 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:15.586403 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" path="/var/lib/kubelet/pods/29aca718-e62b-4406-b8e4-10a6fd97b84b/volumes" Jul 02 14:10:15.642808 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:15.642717 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" podStartSLOduration=0.835403963 podStartE2EDuration="5.642700897s" totalImagesPullingTime="4.807296934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:10:15.642115564 +0000 UTC m=+540.516100752" watchObservedRunningTime="2026-07-02 14:10:15.642700897 +0000 UTC m=+540.516686095" Jul 02 14:10:16.571721 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:16.571688 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:47.579788 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:47.579756 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8cgl6" Jul 02 14:10:57.965106 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.965060 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:10:57.965477 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.965363 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" Jul 02 14:10:57.965477 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.965375 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" Jul 02 14:10:57.965477 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.965440 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29aca718-e62b-4406-b8e4-10a6fd97b84b" containerName="discovery" Jul 02 14:10:57.967357 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.967340 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:10:57.971012 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.970993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 14:10:57.972368 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.972351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 14:10:57.972484 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.972366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fm5v2\"" Jul 02 14:10:57.984291 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:57.984273 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:10:58.053762 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.053721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhtq\" (UniqueName: \"kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq\") pod \"kuadrant-operator-catalog-8lf9f\" (UID: \"5bd7889f-41a2-4207-9598-e5961a9a558c\") " pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:10:58.155023 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.154989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhtq\" (UniqueName: \"kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq\") pod \"kuadrant-operator-catalog-8lf9f\" (UID: \"5bd7889f-41a2-4207-9598-e5961a9a558c\") " pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:10:58.169876 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.169841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhtq\" (UniqueName: \"kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq\") pod \"kuadrant-operator-catalog-8lf9f\" (UID: \"5bd7889f-41a2-4207-9598-e5961a9a558c\") " pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:10:58.276602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.276576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:10:58.283872 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.283849 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:10:58.411223 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.411199 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:10:58.413741 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:10:58.413706 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd7889f_41a2_4207_9598_e5961a9a558c.slice/crio-dc9785a272ac116f704793875fc7573659aed98732f7cb4517fa6e2fb1241936 WatchSource:0}: Error finding container dc9785a272ac116f704793875fc7573659aed98732f7cb4517fa6e2fb1241936: Status 404 returned error can't find the container with id dc9785a272ac116f704793875fc7573659aed98732f7cb4517fa6e2fb1241936 Jul 02 14:10:58.504924 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.504892 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-np8b2"] Jul 02 14:10:58.507730 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.507715 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:10:58.532592 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.532531 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-np8b2"] Jul 02 14:10:58.558832 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.558806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbxg\" (UniqueName: \"kubernetes.io/projected/3ca353e0-0c68-41ac-9c16-d0565a158bd5-kube-api-access-5zbxg\") pod \"kuadrant-operator-catalog-np8b2\" (UID: \"3ca353e0-0c68-41ac-9c16-d0565a158bd5\") " pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:10:58.659250 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.659213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbxg\" (UniqueName: \"kubernetes.io/projected/3ca353e0-0c68-41ac-9c16-d0565a158bd5-kube-api-access-5zbxg\") pod \"kuadrant-operator-catalog-np8b2\" (UID: \"3ca353e0-0c68-41ac-9c16-d0565a158bd5\") " pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:10:58.668479 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.668448 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbxg\" (UniqueName: \"kubernetes.io/projected/3ca353e0-0c68-41ac-9c16-d0565a158bd5-kube-api-access-5zbxg\") pod \"kuadrant-operator-catalog-np8b2\" (UID: \"3ca353e0-0c68-41ac-9c16-d0565a158bd5\") " pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:10:58.731737 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.731705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" event={"ID":"5bd7889f-41a2-4207-9598-e5961a9a558c","Type":"ContainerStarted","Data":"dc9785a272ac116f704793875fc7573659aed98732f7cb4517fa6e2fb1241936"} Jul 02 14:10:58.816767 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.816693 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:10:58.960213 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:58.960184 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-np8b2"] Jul 02 14:10:58.962403 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:10:58.962381 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca353e0_0c68_41ac_9c16_d0565a158bd5.slice/crio-37c2a1050a8b80a2c23c187cec04f2c5533dfab326db483362af7f4c9506ec02 WatchSource:0}: Error finding container 37c2a1050a8b80a2c23c187cec04f2c5533dfab326db483362af7f4c9506ec02: Status 404 returned error can't find the container with id 37c2a1050a8b80a2c23c187cec04f2c5533dfab326db483362af7f4c9506ec02 Jul 02 14:10:59.738865 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:10:59.738811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" event={"ID":"3ca353e0-0c68-41ac-9c16-d0565a158bd5","Type":"ContainerStarted","Data":"37c2a1050a8b80a2c23c187cec04f2c5533dfab326db483362af7f4c9506ec02"} Jul 02 14:11:00.746135 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.746103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" event={"ID":"5bd7889f-41a2-4207-9598-e5961a9a558c","Type":"ContainerStarted","Data":"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3"} Jul 02 14:11:00.746590 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.746176 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" podUID="5bd7889f-41a2-4207-9598-e5961a9a558c" containerName="registry-server" containerID="cri-o://ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3" gracePeriod=2 Jul 02 14:11:00.748956 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.748899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" event={"ID":"3ca353e0-0c68-41ac-9c16-d0565a158bd5","Type":"ContainerStarted","Data":"d0b23c640180b6221ca4d68ace16007d2a1f9afa6fe28c940fda5173b52849d8"} Jul 02 14:11:00.768744 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.768699 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" podStartSLOduration=1.536872249 podStartE2EDuration="3.768682261s" totalImagesPullingTime="2.231810012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:00.766748164 +0000 UTC m=+585.640733348" watchObservedRunningTime="2026-07-02 14:11:00.768682261 +0000 UTC m=+585.642667445" Jul 02 14:11:00.785173 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.785127 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" podStartSLOduration=1.088618291 podStartE2EDuration="2.785108761s" totalImagesPullingTime="1.69649047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:00.784830312 +0000 UTC m=+585.658815496" watchObservedRunningTime="2026-07-02 14:11:00.785108761 +0000 UTC m=+585.659093946" Jul 02 14:11:00.986124 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.986102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8lf9f_5bd7889f-41a2-4207-9598-e5961a9a558c/registry-server/0.log" Jul 02 14:11:00.987249 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:00.987234 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:11:01.079277 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.079243 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhhtq\" (UniqueName: \"kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq\") pod \"5bd7889f-41a2-4207-9598-e5961a9a558c\" (UID: \"5bd7889f-41a2-4207-9598-e5961a9a558c\") " Jul 02 14:11:01.081408 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.081365 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq" (OuterVolumeSpecName: "kube-api-access-xhhtq") pod "5bd7889f-41a2-4207-9598-e5961a9a558c" (UID: "5bd7889f-41a2-4207-9598-e5961a9a558c"). InnerVolumeSpecName "kube-api-access-xhhtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:11:01.180191 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.180107 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhhtq\" (UniqueName: \"kubernetes.io/projected/5bd7889f-41a2-4207-9598-e5961a9a558c-kube-api-access-xhhtq\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:11:01.754300 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754274 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8lf9f_5bd7889f-41a2-4207-9598-e5961a9a558c/registry-server/0.log" Jul 02 14:11:01.754683 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754316 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bd7889f-41a2-4207-9598-e5961a9a558c" containerID="ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3" exitCode=2 Jul 02 14:11:01.754683 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754358 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" Jul 02 14:11:01.754683 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" event={"ID":"5bd7889f-41a2-4207-9598-e5961a9a558c","Type":"ContainerDied","Data":"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3"} Jul 02 14:11:01.754683 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8lf9f" event={"ID":"5bd7889f-41a2-4207-9598-e5961a9a558c","Type":"ContainerDied","Data":"dc9785a272ac116f704793875fc7573659aed98732f7cb4517fa6e2fb1241936"} Jul 02 14:11:01.754683 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.754477 2565 scope.go:117] "RemoveContainer" containerID="ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3" Jul 02 14:11:01.762510 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.762493 2565 scope.go:117] "RemoveContainer" containerID="ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3" Jul 02 14:11:01.762763 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:11:01.762744 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3\": container with ID starting with ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3 not found: ID does not exist" containerID="ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3" Jul 02 14:11:01.762831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.762770 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3"} err="failed to get container status \"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3\": rpc error: code = NotFound desc = could not find container \"ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3\": container with ID starting with ae28df754d43b9ce5f4316d87f7e958d223a497eac4deda596b9cd1077e041f3 not found: ID does not exist" Jul 02 14:11:01.776263 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.776242 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:11:01.777979 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:01.777957 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8lf9f"] Jul 02 14:11:03.586343 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:03.586309 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd7889f-41a2-4207-9598-e5961a9a558c" path="/var/lib/kubelet/pods/5bd7889f-41a2-4207-9598-e5961a9a558c/volumes" Jul 02 14:11:08.817325 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:08.817294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:11:08.817846 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:08.817351 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:11:08.839476 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:08.839452 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:11:09.808961 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:09.808937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-np8b2" Jul 02 14:11:15.549027 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:15.548994 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:11:15.549696 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:15.549246 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:11:32.242068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.242033 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4"] Jul 02 14:11:32.243669 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.242344 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd7889f-41a2-4207-9598-e5961a9a558c" containerName="registry-server" Jul 02 14:11:32.243669 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.242355 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd7889f-41a2-4207-9598-e5961a9a558c" containerName="registry-server" Jul 02 14:11:32.243669 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.242410 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd7889f-41a2-4207-9598-e5961a9a558c" containerName="registry-server" Jul 02 14:11:32.244261 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.244246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:32.246848 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.246825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b7k7v\"" Jul 02 14:11:32.258899 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.258867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4"] Jul 02 14:11:32.345875 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.345836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxwn7\" (UniqueName: \"kubernetes.io/projected/ac35cfc1-7cb9-4ce9-a9e1-239676ff9358-kube-api-access-rxwn7\") pod \"authorino-operator-75cc8d5cb7-j7jq4\" (UID: \"ac35cfc1-7cb9-4ce9-a9e1-239676ff9358\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:32.446436 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.446401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxwn7\" (UniqueName: \"kubernetes.io/projected/ac35cfc1-7cb9-4ce9-a9e1-239676ff9358-kube-api-access-rxwn7\") pod \"authorino-operator-75cc8d5cb7-j7jq4\" (UID: \"ac35cfc1-7cb9-4ce9-a9e1-239676ff9358\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:32.461033 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.461003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxwn7\" (UniqueName: \"kubernetes.io/projected/ac35cfc1-7cb9-4ce9-a9e1-239676ff9358-kube-api-access-rxwn7\") pod \"authorino-operator-75cc8d5cb7-j7jq4\" (UID: \"ac35cfc1-7cb9-4ce9-a9e1-239676ff9358\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:32.553962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.553932 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:32.697796 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.697772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4"] Jul 02 14:11:32.699606 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:11:32.699580 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac35cfc1_7cb9_4ce9_a9e1_239676ff9358.slice/crio-16c440a6127403340ec93ad1c616032653c04978d1af26f2ce9b325ae3fc60b1 WatchSource:0}: Error finding container 16c440a6127403340ec93ad1c616032653c04978d1af26f2ce9b325ae3fc60b1: Status 404 returned error can't find the container with id 16c440a6127403340ec93ad1c616032653c04978d1af26f2ce9b325ae3fc60b1 Jul 02 14:11:32.701531 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.701516 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:11:32.878253 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:32.878158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" event={"ID":"ac35cfc1-7cb9-4ce9-a9e1-239676ff9358","Type":"ContainerStarted","Data":"16c440a6127403340ec93ad1c616032653c04978d1af26f2ce9b325ae3fc60b1"} Jul 02 14:11:35.892186 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:35.892149 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" event={"ID":"ac35cfc1-7cb9-4ce9-a9e1-239676ff9358","Type":"ContainerStarted","Data":"f76e086ab2a4324b9f7dd5eb82e77a6ccefadb16920495ea470d1075c5e21f5e"} Jul 02 14:11:35.892559 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:35.892229 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:35.920584 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:35.920538 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" podStartSLOduration=1.171950601 podStartE2EDuration="3.920523917s" totalImagesPullingTime="2.748573316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:35.91884616 +0000 UTC m=+620.792831344" watchObservedRunningTime="2026-07-02 14:11:35.920523917 +0000 UTC m=+620.794509101" Jul 02 14:11:37.632761 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.632728 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6"] Jul 02 14:11:37.635999 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.635984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.638751 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.638724 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-prm46\"" Jul 02 14:11:37.656713 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.656692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6"] Jul 02 14:11:37.793329 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.793296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.793491 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.793377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75tdl\" (UniqueName: \"kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.894205 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.894115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75tdl\" (UniqueName: \"kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.894205 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.894181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.894563 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.894541 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.903982 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.903958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75tdl\" (UniqueName: \"kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:37.946135 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:37.946108 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:38.087702 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:38.087437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6"] Jul 02 14:11:38.091786 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:11:38.091759 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe0e21a_3c04_481f_8c9d_160233709e0f.slice/crio-1fdf297c4bd0cae054447ec26e8b0b4b8da6282b1d3d495afc78d79619827693 WatchSource:0}: Error finding container 1fdf297c4bd0cae054447ec26e8b0b4b8da6282b1d3d495afc78d79619827693: Status 404 returned error can't find the container with id 1fdf297c4bd0cae054447ec26e8b0b4b8da6282b1d3d495afc78d79619827693 Jul 02 14:11:38.905899 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:38.905860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" event={"ID":"bfe0e21a-3c04-481f-8c9d-160233709e0f","Type":"ContainerStarted","Data":"1fdf297c4bd0cae054447ec26e8b0b4b8da6282b1d3d495afc78d79619827693"} Jul 02 14:11:39.971391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:39.971354 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq"] Jul 02 14:11:39.975638 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:39.975618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:39.979543 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:39.979523 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 14:11:39.979634 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:39.979541 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5cxjr\"" Jul 02 14:11:39.989184 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:39.989163 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq"] Jul 02 14:11:40.112419 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.112379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht256\" (UniqueName: \"kubernetes.io/projected/83569746-248e-47e2-86b8-eca5376b82b9-kube-api-access-ht256\") pod \"dns-operator-controller-manager-864dd78c4c-9hqzq\" (UID: \"83569746-248e-47e2-86b8-eca5376b82b9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:40.213814 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.213777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht256\" (UniqueName: \"kubernetes.io/projected/83569746-248e-47e2-86b8-eca5376b82b9-kube-api-access-ht256\") pod \"dns-operator-controller-manager-864dd78c4c-9hqzq\" (UID: \"83569746-248e-47e2-86b8-eca5376b82b9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:40.224366 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.224309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht256\" (UniqueName: \"kubernetes.io/projected/83569746-248e-47e2-86b8-eca5376b82b9-kube-api-access-ht256\") pod \"dns-operator-controller-manager-864dd78c4c-9hqzq\" (UID: \"83569746-248e-47e2-86b8-eca5376b82b9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:40.285764 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.285731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:40.417986 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.417959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq"] Jul 02 14:11:40.419827 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:11:40.419785 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83569746_248e_47e2_86b8_eca5376b82b9.slice/crio-45f930b85b707cefbc88585772866ea25d345e0b59e37ac34bb069f14d1b2fa7 WatchSource:0}: Error finding container 45f930b85b707cefbc88585772866ea25d345e0b59e37ac34bb069f14d1b2fa7: Status 404 returned error can't find the container with id 45f930b85b707cefbc88585772866ea25d345e0b59e37ac34bb069f14d1b2fa7 Jul 02 14:11:40.918256 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:40.918225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" event={"ID":"83569746-248e-47e2-86b8-eca5376b82b9","Type":"ContainerStarted","Data":"45f930b85b707cefbc88585772866ea25d345e0b59e37ac34bb069f14d1b2fa7"} Jul 02 14:11:42.805060 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.805017 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh"] Jul 02 14:11:42.811823 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.811783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:42.815068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.815044 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n5h64\"" Jul 02 14:11:42.822043 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.822018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh"] Jul 02 14:11:42.838499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.838460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6sh\" (UniqueName: \"kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh\") pod \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" (UID: \"72b5fe7b-6a92-4e0e-9cc6-f316aa205106\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:42.939198 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.939174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6sh\" (UniqueName: \"kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh\") pod \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" (UID: \"72b5fe7b-6a92-4e0e-9cc6-f316aa205106\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:42.954312 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:42.954291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6sh\" (UniqueName: \"kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh\") pod \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" (UID: \"72b5fe7b-6a92-4e0e-9cc6-f316aa205106\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:43.125790 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:43.125700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:43.276844 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:43.276816 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh"] Jul 02 14:11:43.279630 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:11:43.279605 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b5fe7b_6a92_4e0e_9cc6_f316aa205106.slice/crio-1c3133047fb9c920d786289e6231152b2347ceb9b9c8f1abb1549e4ed5ed85ce WatchSource:0}: Error finding container 1c3133047fb9c920d786289e6231152b2347ceb9b9c8f1abb1549e4ed5ed85ce: Status 404 returned error can't find the container with id 1c3133047fb9c920d786289e6231152b2347ceb9b9c8f1abb1549e4ed5ed85ce Jul 02 14:11:43.932673 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:43.932640 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" event={"ID":"83569746-248e-47e2-86b8-eca5376b82b9","Type":"ContainerStarted","Data":"0c3f573acb065fee3cc431a6b8010789add1cd420a69f10c177bc0b109ef33f0"} Jul 02 14:11:43.933141 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:43.932796 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:43.933817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:43.933795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" event={"ID":"72b5fe7b-6a92-4e0e-9cc6-f316aa205106","Type":"ContainerStarted","Data":"1c3133047fb9c920d786289e6231152b2347ceb9b9c8f1abb1549e4ed5ed85ce"} Jul 02 14:11:45.944224 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:45.944177 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" event={"ID":"72b5fe7b-6a92-4e0e-9cc6-f316aa205106","Type":"ContainerStarted","Data":"3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c"} Jul 02 14:11:45.944692 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:45.944345 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:45.965018 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:45.964968 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" podStartSLOduration=1.455663407 podStartE2EDuration="3.964949617s" totalImagesPullingTime="2.50928621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:45.963635692 +0000 UTC m=+630.837620877" watchObservedRunningTime="2026-07-02 14:11:45.964949617 +0000 UTC m=+630.838934803" Jul 02 14:11:45.965272 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:45.965243 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" podStartSLOduration=4.453710036 podStartE2EDuration="6.965230971s" totalImagesPullingTime="2.511520935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:43.977478009 +0000 UTC m=+628.851463193" watchObservedRunningTime="2026-07-02 14:11:45.965230971 +0000 UTC m=+630.839216157" Jul 02 14:11:46.900004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:46.899972 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j7jq4" Jul 02 14:11:47.956257 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:47.956223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" event={"ID":"bfe0e21a-3c04-481f-8c9d-160233709e0f","Type":"ContainerStarted","Data":"7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884"} Jul 02 14:11:47.956641 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:47.956338 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:11:47.990219 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:47.990169 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" podStartSLOduration=2.026385573 podStartE2EDuration="10.990154579s" totalImagesPullingTime="8.963769006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:11:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:11:47.989998833 +0000 UTC m=+632.863984018" watchObservedRunningTime="2026-07-02 14:11:47.990154579 +0000 UTC m=+632.864139763" Jul 02 14:11:54.939867 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:54.939840 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hqzq" Jul 02 14:11:56.951544 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:56.951517 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:11:58.964052 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:11:58.964025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:00.543447 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.543414 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk"] Jul 02 14:12:00.546845 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.546829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.565616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.565590 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk"] Jul 02 14:12:00.681649 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.681613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d64kq\" (UniqueName: \"kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.681820 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.681672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.782714 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.782682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.782892 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.782780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d64kq\" (UniqueName: \"kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.783046 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.783023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.798200 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.798134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d64kq\" (UniqueName: \"kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.856053 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.856013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:00.986351 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:00.986328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk"] Jul 02 14:12:00.988966 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:00.988943 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc109938e_296b_4588_af5c_2d92e1602f0f.slice/crio-78d2ce972855c7cf8648fa769c64407c2608bb9ae0e7c700e9a343bbb4dabc0e WatchSource:0}: Error finding container 78d2ce972855c7cf8648fa769c64407c2608bb9ae0e7c700e9a343bbb4dabc0e: Status 404 returned error can't find the container with id 78d2ce972855c7cf8648fa769c64407c2608bb9ae0e7c700e9a343bbb4dabc0e Jul 02 14:12:01.015360 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.015324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" event={"ID":"c109938e-296b-4588-af5c-2d92e1602f0f","Type":"ContainerStarted","Data":"78d2ce972855c7cf8648fa769c64407c2608bb9ae0e7c700e9a343bbb4dabc0e"} Jul 02 14:12:01.398234 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.398200 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk"] Jul 02 14:12:01.414880 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.414856 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk"] Jul 02 14:12:01.431744 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.431721 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6"] Jul 02 14:12:01.431964 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.431933 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" containerName="manager" containerID="cri-o://7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884" gracePeriod=2 Jul 02 14:12:01.448132 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.448105 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6"] Jul 02 14:12:01.495407 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.495365 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"bfe0e21a-3c04-481f-8c9d-160233709e0f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:01.500504 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.500479 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:01.500944 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.500929 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" containerName="manager" Jul 02 14:12:01.500991 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.500949 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" containerName="manager" Jul 02 14:12:01.500991 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.500976 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" containerName="manager" Jul 02 14:12:01.500991 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.500985 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" containerName="manager" Jul 02 14:12:01.501113 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.501067 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" containerName="manager" Jul 02 14:12:01.501113 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.501108 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" containerName="manager" Jul 02 14:12:01.504282 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.504265 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh"] Jul 02 14:12:01.504380 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.504365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.504457 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.504438 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" containerName="manager" containerID="cri-o://3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c" gracePeriod=2 Jul 02 14:12:01.518068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.518048 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh"] Jul 02 14:12:01.526824 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.526803 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:01.550178 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.550150 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:01.552902 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.552849 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:12:01.557302 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.557273 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:12:01.559471 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.559436 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:01.576509 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.576487 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649"] Jul 02 14:12:01.576866 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.576849 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" containerName="manager" Jul 02 14:12:01.576929 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.576867 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" containerName="manager" Jul 02 14:12:01.576965 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.576947 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" containerName="manager" Jul 02 14:12:01.580110 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.580063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:01.589724 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.589700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.589830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.589777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnd8\" (UniqueName: \"kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.601854 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.601834 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649"] Jul 02 14:12:01.640027 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.639991 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ltjj6\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:01.643280 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:01.642799 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xvgbh\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:12:01.690759 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.690725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnd8\" (UniqueName: \"kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.691197 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.691171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.691312 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.691288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86mtm\" (UniqueName: \"kubernetes.io/projected/b0012a43-4fbe-4c77-9593-42630943ff4a-kube-api-access-86mtm\") pod \"limitador-operator-controller-manager-859d7b78bd-f2649\" (UID: \"b0012a43-4fbe-4c77-9593-42630943ff4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:01.691564 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.691539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.702796 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.702768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnd8\" (UniqueName: \"kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqpg5\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.734953 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.734929 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:01.743576 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.743556 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:12:01.792599 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.792576 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume\") pod \"bfe0e21a-3c04-481f-8c9d-160233709e0f\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " Jul 02 14:12:01.792731 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.792607 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75tdl\" (UniqueName: \"kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl\") pod \"bfe0e21a-3c04-481f-8c9d-160233709e0f\" (UID: \"bfe0e21a-3c04-481f-8c9d-160233709e0f\") " Jul 02 14:12:01.792731 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.792645 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz6sh\" (UniqueName: \"kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh\") pod \"72b5fe7b-6a92-4e0e-9cc6-f316aa205106\" (UID: \"72b5fe7b-6a92-4e0e-9cc6-f316aa205106\") " Jul 02 14:12:01.792731 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.792705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86mtm\" (UniqueName: \"kubernetes.io/projected/b0012a43-4fbe-4c77-9593-42630943ff4a-kube-api-access-86mtm\") pod \"limitador-operator-controller-manager-859d7b78bd-f2649\" (UID: \"b0012a43-4fbe-4c77-9593-42630943ff4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:01.793101 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.793049 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bfe0e21a-3c04-481f-8c9d-160233709e0f" (UID: "bfe0e21a-3c04-481f-8c9d-160233709e0f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:12:01.794656 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.794636 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl" (OuterVolumeSpecName: "kube-api-access-75tdl") pod "bfe0e21a-3c04-481f-8c9d-160233709e0f" (UID: "bfe0e21a-3c04-481f-8c9d-160233709e0f"). InnerVolumeSpecName "kube-api-access-75tdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:01.794733 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.794670 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh" (OuterVolumeSpecName: "kube-api-access-vz6sh") pod "72b5fe7b-6a92-4e0e-9cc6-f316aa205106" (UID: "72b5fe7b-6a92-4e0e-9cc6-f316aa205106"). InnerVolumeSpecName "kube-api-access-vz6sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:01.801436 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.801416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86mtm\" (UniqueName: \"kubernetes.io/projected/b0012a43-4fbe-4c77-9593-42630943ff4a-kube-api-access-86mtm\") pod \"limitador-operator-controller-manager-859d7b78bd-f2649\" (UID: \"b0012a43-4fbe-4c77-9593-42630943ff4a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:01.855388 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.855362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:01.891277 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.891247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:01.893279 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.893249 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz6sh\" (UniqueName: \"kubernetes.io/projected/72b5fe7b-6a92-4e0e-9cc6-f316aa205106-kube-api-access-vz6sh\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:01.893279 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.893283 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfe0e21a-3c04-481f-8c9d-160233709e0f-extensions-socket-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:01.893426 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:01.893298 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75tdl\" (UniqueName: \"kubernetes.io/projected/bfe0e21a-3c04-481f-8c9d-160233709e0f-kube-api-access-75tdl\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:02.022176 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.022141 2565 generic.go:356] "Generic (PLEG): container finished" podID="bfe0e21a-3c04-481f-8c9d-160233709e0f" containerID="7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884" exitCode=0 Jul 02 14:12:02.022330 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.022187 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ltjj6" Jul 02 14:12:02.022330 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.022208 2565 scope.go:117] "RemoveContainer" containerID="7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884" Jul 02 14:12:02.023464 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.023442 2565 generic.go:356] "Generic (PLEG): container finished" podID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" containerID="3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c" exitCode=0 Jul 02 14:12:02.023582 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.023484 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xvgbh" Jul 02 14:12:02.025600 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:02.025578 2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" container="manager" Jul 02 14:12:02.028926 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.028902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:02.033013 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.032488 2565 scope.go:117] "RemoveContainer" containerID="7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884" Jul 02 14:12:02.033158 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:02.033131 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884\": container with ID starting with 7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884 not found: ID does not exist" containerID="7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884" Jul 02 14:12:02.033220 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.033162 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884"} err="failed to get container status \"7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884\": rpc error: code = NotFound desc = could not find container \"7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884\": container with ID starting with 7cf9d80f491190323e0065ee3f1fdc8c0c9ee9c135d80eb1c2bba90a7bf04884 not found: ID does not exist" Jul 02 14:12:02.033220 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.033183 2565 scope.go:117] "RemoveContainer" containerID="3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c" Jul 02 14:12:02.033853 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:02.033830 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082afd65_6ef5_4ad9_a8e3_8e49d21e4e34.slice/crio-e5d7fabfbfd7cd150121d0c894c5bcb1a1b6bac6e2e870612375faefe7cb7875 WatchSource:0}: Error finding container e5d7fabfbfd7cd150121d0c894c5bcb1a1b6bac6e2e870612375faefe7cb7875: Status 404 returned error can't find the container with id e5d7fabfbfd7cd150121d0c894c5bcb1a1b6bac6e2e870612375faefe7cb7875 Jul 02 14:12:02.042652 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.042637 2565 scope.go:117] "RemoveContainer" containerID="3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c" Jul 02 14:12:02.042918 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:02.042897 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c\": container with ID starting with 3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c not found: ID does not exist" containerID="3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c" Jul 02 14:12:02.042973 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.042926 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c"} err="failed to get container status \"3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c\": rpc error: code = NotFound desc = could not find container \"3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c\": container with ID starting with 3ebb0ac88798a7055eef42fe5f2a925524d942645717b96f68931f85bead347c not found: ID does not exist" Jul 02 14:12:02.086342 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:02.086307 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0012a43_4fbe_4c77_9593_42630943ff4a.slice/crio-0e7d8acaed47fe1bbfeca3e4f1a89d2bc0312044585090ef6befda65ee341caf WatchSource:0}: Error finding container 0e7d8acaed47fe1bbfeca3e4f1a89d2bc0312044585090ef6befda65ee341caf: Status 404 returned error can't find the container with id 0e7d8acaed47fe1bbfeca3e4f1a89d2bc0312044585090ef6befda65ee341caf Jul 02 14:12:02.087382 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:02.087363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649"] Jul 02 14:12:03.031912 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.031874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" event={"ID":"b0012a43-4fbe-4c77-9593-42630943ff4a","Type":"ContainerStarted","Data":"0edb6ddf58a9bba53845eea1a54327e90c335cae1000837157b43914301a2db0"} Jul 02 14:12:03.032364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.031954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" event={"ID":"b0012a43-4fbe-4c77-9593-42630943ff4a","Type":"ContainerStarted","Data":"0e7d8acaed47fe1bbfeca3e4f1a89d2bc0312044585090ef6befda65ee341caf"} Jul 02 14:12:03.032364 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.031981 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:03.035249 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.035204 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" containerName="manager" containerID="cri-o://355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284" gracePeriod=2 Jul 02 14:12:03.036732 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.036703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" event={"ID":"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34","Type":"ContainerStarted","Data":"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35"} Jul 02 14:12:03.036856 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.036753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" event={"ID":"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34","Type":"ContainerStarted","Data":"e5d7fabfbfd7cd150121d0c894c5bcb1a1b6bac6e2e870612375faefe7cb7875"} Jul 02 14:12:03.036856 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.036795 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:03.052687 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.052645 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" podStartSLOduration=2.052630779 podStartE2EDuration="2.052630779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:03.052415501 +0000 UTC m=+647.926400686" watchObservedRunningTime="2026-07-02 14:12:03.052630779 +0000 UTC m=+647.926615962" Jul 02 14:12:03.079317 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.079265 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" podStartSLOduration=2.079245423 podStartE2EDuration="2.079245423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:03.077817918 +0000 UTC m=+647.951803103" watchObservedRunningTime="2026-07-02 14:12:03.079245423 +0000 UTC m=+647.953230611" Jul 02 14:12:03.081545 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:03.081513 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:03.288601 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.288540 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:03.292121 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:03.292070 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:03.404055 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.404022 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d64kq\" (UniqueName: \"kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq\") pod \"c109938e-296b-4588-af5c-2d92e1602f0f\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " Jul 02 14:12:03.404234 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.404063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume\") pod \"c109938e-296b-4588-af5c-2d92e1602f0f\" (UID: \"c109938e-296b-4588-af5c-2d92e1602f0f\") " Jul 02 14:12:03.404468 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.404446 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c109938e-296b-4588-af5c-2d92e1602f0f" (UID: "c109938e-296b-4588-af5c-2d92e1602f0f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:12:03.406106 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.406069 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq" (OuterVolumeSpecName: "kube-api-access-d64kq") pod "c109938e-296b-4588-af5c-2d92e1602f0f" (UID: "c109938e-296b-4588-af5c-2d92e1602f0f"). InnerVolumeSpecName "kube-api-access-d64kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:03.505727 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.505689 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d64kq\" (UniqueName: \"kubernetes.io/projected/c109938e-296b-4588-af5c-2d92e1602f0f-kube-api-access-d64kq\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:03.505727 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.505719 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c109938e-296b-4588-af5c-2d92e1602f0f-extensions-socket-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:03.586686 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.586612 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b5fe7b-6a92-4e0e-9cc6-f316aa205106" path="/var/lib/kubelet/pods/72b5fe7b-6a92-4e0e-9cc6-f316aa205106/volumes" Jul 02 14:12:03.586962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.586949 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe0e21a-3c04-481f-8c9d-160233709e0f" path="/var/lib/kubelet/pods/bfe0e21a-3c04-481f-8c9d-160233709e0f/volumes" Jul 02 14:12:03.587272 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:03.587259 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" path="/var/lib/kubelet/pods/c109938e-296b-4588-af5c-2d92e1602f0f/volumes" Jul 02 14:12:04.042777 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:04.042749 2565 generic.go:356] "Generic (PLEG): container finished" podID="c109938e-296b-4588-af5c-2d92e1602f0f" containerID="355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284" exitCode=0 Jul 02 14:12:04.043230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:04.042793 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:04.043230 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:04.042857 2565 scope.go:117] "RemoveContainer" containerID="355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284" Jul 02 14:12:04.047786 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:04.047756 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:04.051293 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:04.051277 2565 scope.go:117] "RemoveContainer" containerID="355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284" Jul 02 14:12:04.051553 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:04.051530 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284\": container with ID starting with 355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284 not found: ID does not exist" containerID="355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284" Jul 02 14:12:04.051648 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:04.051560 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284"} err="failed to get container status \"355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284\": rpc error: code = NotFound desc = could not find container \"355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284\": container with ID starting with 355ed9a922b49892e3cedf4f68cc38f798531a403ab905fe9f375447af435284 not found: ID does not exist" Jul 02 14:12:05.585613 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:05.585571 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ccqlk\" is forbidden: User \"system:node:ip-10-0-132-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-214.ec2.internal' and this object" podUID="c109938e-296b-4588-af5c-2d92e1602f0f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ccqlk" Jul 02 14:12:14.045858 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:14.045828 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:14.046550 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:14.045998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2649" Jul 02 14:12:34.088621 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.088582 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:34.089136 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.088807 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" podUID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" containerName="manager" containerID="cri-o://5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35" gracePeriod=10 Jul 02 14:12:34.334409 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.334386 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:34.408093 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.408005 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q"] Jul 02 14:12:34.408387 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.408374 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" containerName="manager" Jul 02 14:12:34.408435 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.408389 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" containerName="manager" Jul 02 14:12:34.408470 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.408440 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" containerName="manager" Jul 02 14:12:34.410358 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.410344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.439371 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.439342 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q"] Jul 02 14:12:34.464487 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.464462 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume\") pod \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " Jul 02 14:12:34.464600 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.464490 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlnd8\" (UniqueName: \"kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8\") pod \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\" (UID: \"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34\") " Jul 02 14:12:34.464832 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.464811 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" (UID: "082afd65-6ef5-4ad9-a8e3-8e49d21e4e34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:12:34.466499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.466478 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8" (OuterVolumeSpecName: "kube-api-access-vlnd8") pod "082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" (UID: "082afd65-6ef5-4ad9-a8e3-8e49d21e4e34"). InnerVolumeSpecName "kube-api-access-vlnd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:12:34.565439 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.565410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d130ba3c-23eb-4780-975c-8360fc7ecf09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.565563 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.565460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnfb6\" (UniqueName: \"kubernetes.io/projected/d130ba3c-23eb-4780-975c-8360fc7ecf09-kube-api-access-wnfb6\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.565563 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.565545 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-extensions-socket-volume\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:34.565563 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.565556 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlnd8\" (UniqueName: \"kubernetes.io/projected/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34-kube-api-access-vlnd8\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:12:34.666043 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.665970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnfb6\" (UniqueName: \"kubernetes.io/projected/d130ba3c-23eb-4780-975c-8360fc7ecf09-kube-api-access-wnfb6\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.666174 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.666124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d130ba3c-23eb-4780-975c-8360fc7ecf09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.666467 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.666451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d130ba3c-23eb-4780-975c-8360fc7ecf09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.678242 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.678214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnfb6\" (UniqueName: \"kubernetes.io/projected/d130ba3c-23eb-4780-975c-8360fc7ecf09-kube-api-access-wnfb6\") pod \"kuadrant-operator-controller-manager-86878c769f-mm46q\" (UID: \"d130ba3c-23eb-4780-975c-8360fc7ecf09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.720035 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.720013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:34.874383 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:34.874352 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q"] Jul 02 14:12:34.877506 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:34.877481 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd130ba3c_23eb_4780_975c_8360fc7ecf09.slice/crio-525a7724f99b2e7e4ad7b9b1e0dd9493a631cf44e227be1bfbff4e54e53e06a0 WatchSource:0}: Error finding container 525a7724f99b2e7e4ad7b9b1e0dd9493a631cf44e227be1bfbff4e54e53e06a0: Status 404 returned error can't find the container with id 525a7724f99b2e7e4ad7b9b1e0dd9493a631cf44e227be1bfbff4e54e53e06a0 Jul 02 14:12:35.180665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.180580 2565 generic.go:356] "Generic (PLEG): container finished" podID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" containerID="5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35" exitCode=0 Jul 02 14:12:35.180665 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.180625 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" Jul 02 14:12:35.181201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.180664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" event={"ID":"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34","Type":"ContainerDied","Data":"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35"} Jul 02 14:12:35.181201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.180728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5" event={"ID":"082afd65-6ef5-4ad9-a8e3-8e49d21e4e34","Type":"ContainerDied","Data":"e5d7fabfbfd7cd150121d0c894c5bcb1a1b6bac6e2e870612375faefe7cb7875"} Jul 02 14:12:35.181201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.180760 2565 scope.go:117] "RemoveContainer" containerID="5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35" Jul 02 14:12:35.182505 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.182469 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" event={"ID":"d130ba3c-23eb-4780-975c-8360fc7ecf09","Type":"ContainerStarted","Data":"d9653ac8b265d2a29840767871420d713fabb2301cf601945845bbceacd256ec"} Jul 02 14:12:35.182632 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.182521 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:35.182632 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.182545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" event={"ID":"d130ba3c-23eb-4780-975c-8360fc7ecf09","Type":"ContainerStarted","Data":"525a7724f99b2e7e4ad7b9b1e0dd9493a631cf44e227be1bfbff4e54e53e06a0"} Jul 02 14:12:35.190814 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.190795 2565 scope.go:117] "RemoveContainer" containerID="5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35" Jul 02 14:12:35.191092 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:12:35.191061 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35\": container with ID starting with 5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35 not found: ID does not exist" containerID="5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35" Jul 02 14:12:35.191165 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.191111 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35"} err="failed to get container status \"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35\": rpc error: code = NotFound desc = could not find container \"5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35\": container with ID starting with 5001ed4284424b9a13c7c6fdc02463fa6bf93749ce046ea83810740605d7ee35 not found: ID does not exist" Jul 02 14:12:35.207136 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.207053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" podStartSLOduration=1.207034743 podStartE2EDuration="1.207034743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:35.206608382 +0000 UTC m=+680.080593577" watchObservedRunningTime="2026-07-02 14:12:35.207034743 +0000 UTC m=+680.081019928" Jul 02 14:12:35.223845 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.223814 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:35.230196 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.230171 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqpg5"] Jul 02 14:12:35.589908 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:35.589876 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082afd65-6ef5-4ad9-a8e3-8e49d21e4e34" path="/var/lib/kubelet/pods/082afd65-6ef5-4ad9-a8e3-8e49d21e4e34/volumes" Jul 02 14:12:46.189928 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:46.189897 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mm46q" Jul 02 14:12:50.510095 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.510048 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd"] Jul 02 14:12:50.513483 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.513460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.517519 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.517501 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4gcw5\"" Jul 02 14:12:50.528882 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.528863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd"] Jul 02 14:12:50.598973 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.598946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.598979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmpg\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-kube-api-access-gcmpg\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599111 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.599239 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.599226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700256 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700256 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700507 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700507 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700507 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700661 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmpg\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-kube-api-access-gcmpg\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700862 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700862 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.700962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.700925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.701266 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.701246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.702600 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.702577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.702858 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.702842 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.708667 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.708641 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmpg\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-kube-api-access-gcmpg\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.708899 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.708883 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xx9pd\" (UID: \"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.824012 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.823980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:50.961990 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.961951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd"] Jul 02 14:12:50.964117 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:50.964090 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb410f9_ae1a_44e5_ba2c_a0dedd49f5c3.slice/crio-0223d9fe10767e387d2e3341966eb0c6c4cd075bb7c212feb9ddbe4703ad9c37 WatchSource:0}: Error finding container 0223d9fe10767e387d2e3341966eb0c6c4cd075bb7c212feb9ddbe4703ad9c37: Status 404 returned error can't find the container with id 0223d9fe10767e387d2e3341966eb0c6c4cd075bb7c212feb9ddbe4703ad9c37 Jul 02 14:12:50.966105 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.966055 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:12:50.966220 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.966135 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:12:50.966220 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:50.966179 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:12:51.260155 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:51.260044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" event={"ID":"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3","Type":"ContainerStarted","Data":"0636ce0035bf246ddf68491c97ff249b13a85cddd4e38e8c17ae8fa48cfad146"} Jul 02 14:12:51.260155 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:51.260117 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" event={"ID":"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3","Type":"ContainerStarted","Data":"0223d9fe10767e387d2e3341966eb0c6c4cd075bb7c212feb9ddbe4703ad9c37"} Jul 02 14:12:51.280621 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:51.280575 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podStartSLOduration=1.280559077 podStartE2EDuration="1.280559077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:51.279472659 +0000 UTC m=+696.153457867" watchObservedRunningTime="2026-07-02 14:12:51.280559077 +0000 UTC m=+696.154544260" Jul 02 14:12:51.824462 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:51.824428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:52.829861 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:52.829830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:53.269450 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:53.269368 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:53.270501 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:53.270479 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:12:54.220057 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.220021 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:12:54.223328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.223308 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:12:54.226136 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.226116 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmjnf\"" Jul 02 14:12:54.231474 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.231448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:12:54.334295 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.334265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhzw\" (UniqueName: \"kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw\") pod \"authorino-58cd955675-qsvmr\" (UID: \"95db9c9b-5911-4f69-aa10-6b08af5267d9\") " pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:12:54.435320 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.435285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhzw\" (UniqueName: \"kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw\") pod \"authorino-58cd955675-qsvmr\" (UID: \"95db9c9b-5911-4f69-aa10-6b08af5267d9\") " pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:12:54.445392 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.445363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhzw\" (UniqueName: \"kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw\") pod \"authorino-58cd955675-qsvmr\" (UID: \"95db9c9b-5911-4f69-aa10-6b08af5267d9\") " pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:12:54.533906 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.533881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:12:54.662128 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:54.662102 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:12:54.664163 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:12:54.664133 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95db9c9b_5911_4f69_aa10_6b08af5267d9.slice/crio-735b0f266acc36408d2a8a7978353cc0e662244950980f28124687bb28734569 WatchSource:0}: Error finding container 735b0f266acc36408d2a8a7978353cc0e662244950980f28124687bb28734569: Status 404 returned error can't find the container with id 735b0f266acc36408d2a8a7978353cc0e662244950980f28124687bb28734569 Jul 02 14:12:55.278822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:55.278788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsvmr" event={"ID":"95db9c9b-5911-4f69-aa10-6b08af5267d9","Type":"ContainerStarted","Data":"735b0f266acc36408d2a8a7978353cc0e662244950980f28124687bb28734569"} Jul 02 14:12:59.302359 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:59.302323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsvmr" event={"ID":"95db9c9b-5911-4f69-aa10-6b08af5267d9","Type":"ContainerStarted","Data":"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e"} Jul 02 14:12:59.330484 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:59.330456 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:12:59.363687 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:12:59.363640 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qsvmr" podStartSLOduration=1.563030494 podStartE2EDuration="5.363624863s" totalImagesPullingTime="3.800594369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:59.36327689 +0000 UTC m=+704.237262075" watchObservedRunningTime="2026-07-02 14:12:59.363624863 +0000 UTC m=+704.237610047" Jul 02 14:13:01.312004 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:01.311954 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qsvmr" podUID="95db9c9b-5911-4f69-aa10-6b08af5267d9" containerName="authorino" containerID="cri-o://3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e" gracePeriod=30 Jul 02 14:13:01.568308 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:01.568248 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:13:01.700767 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:01.700733 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xhzw\" (UniqueName: \"kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw\") pod \"95db9c9b-5911-4f69-aa10-6b08af5267d9\" (UID: \"95db9c9b-5911-4f69-aa10-6b08af5267d9\") " Jul 02 14:13:01.702805 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:01.702772 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw" (OuterVolumeSpecName: "kube-api-access-2xhzw") pod "95db9c9b-5911-4f69-aa10-6b08af5267d9" (UID: "95db9c9b-5911-4f69-aa10-6b08af5267d9"). InnerVolumeSpecName "kube-api-access-2xhzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:01.801774 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:01.801739 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xhzw\" (UniqueName: \"kubernetes.io/projected/95db9c9b-5911-4f69-aa10-6b08af5267d9-kube-api-access-2xhzw\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:13:02.317213 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.317179 2565 generic.go:356] "Generic (PLEG): container finished" podID="95db9c9b-5911-4f69-aa10-6b08af5267d9" containerID="3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e" exitCode=0 Jul 02 14:13:02.317628 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.317221 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsvmr" Jul 02 14:13:02.317628 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.317271 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsvmr" event={"ID":"95db9c9b-5911-4f69-aa10-6b08af5267d9","Type":"ContainerDied","Data":"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e"} Jul 02 14:13:02.317628 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.317310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsvmr" event={"ID":"95db9c9b-5911-4f69-aa10-6b08af5267d9","Type":"ContainerDied","Data":"735b0f266acc36408d2a8a7978353cc0e662244950980f28124687bb28734569"} Jul 02 14:13:02.317628 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.317327 2565 scope.go:117] "RemoveContainer" containerID="3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e" Jul 02 14:13:02.325819 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.325804 2565 scope.go:117] "RemoveContainer" containerID="3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e" Jul 02 14:13:02.326059 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:13:02.326042 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e\": container with ID starting with 3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e not found: ID does not exist" containerID="3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e" Jul 02 14:13:02.326142 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.326065 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e"} err="failed to get container status \"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e\": rpc error: code = NotFound desc = could not find container \"3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e\": container with ID starting with 3759ff1fc225b6e7a68fd4386a1f5865dc49148e9d8715a9a9d871e8e3ed0d8e not found: ID does not exist" Jul 02 14:13:02.356604 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.356577 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:13:02.367702 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:02.367679 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsvmr"] Jul 02 14:13:03.140265 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.140234 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp"] Jul 02 14:13:03.140553 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.140542 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95db9c9b-5911-4f69-aa10-6b08af5267d9" containerName="authorino" Jul 02 14:13:03.140609 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.140555 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95db9c9b-5911-4f69-aa10-6b08af5267d9" containerName="authorino" Jul 02 14:13:03.140643 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.140625 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="95db9c9b-5911-4f69-aa10-6b08af5267d9" containerName="authorino" Jul 02 14:13:03.144969 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.144953 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.148946 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.148927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:13:03.149072 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.148951 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 14:13:03.149072 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.149052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-q2j6r\"" Jul 02 14:13:03.171116 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.171090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp"] Jul 02 14:13:03.214861 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.214833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b27ecc8-6761-43c5-a532-2f77f36b3b27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.215034 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.214879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vsk8\" (UniqueName: \"kubernetes.io/projected/6b27ecc8-6761-43c5-a532-2f77f36b3b27-kube-api-access-7vsk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.315939 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.315908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b27ecc8-6761-43c5-a532-2f77f36b3b27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.316108 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.315951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vsk8\" (UniqueName: \"kubernetes.io/projected/6b27ecc8-6761-43c5-a532-2f77f36b3b27-kube-api-access-7vsk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.316324 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.316305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b27ecc8-6761-43c5-a532-2f77f36b3b27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.339584 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.339559 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vsk8\" (UniqueName: \"kubernetes.io/projected/6b27ecc8-6761-43c5-a532-2f77f36b3b27-kube-api-access-7vsk8\") pod \"cert-manager-operator-controller-manager-55c444bf86-p4cdp\" (UID: \"6b27ecc8-6761-43c5-a532-2f77f36b3b27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.453649 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.453569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" Jul 02 14:13:03.590540 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.590504 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95db9c9b-5911-4f69-aa10-6b08af5267d9" path="/var/lib/kubelet/pods/95db9c9b-5911-4f69-aa10-6b08af5267d9/volumes" Jul 02 14:13:03.594198 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:03.594172 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp"] Jul 02 14:13:03.597320 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:13:03.597284 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b27ecc8_6761_43c5_a532_2f77f36b3b27.slice/crio-61115c175f64e0af770207eca91aec13cb0fbef5ceb6bdea9ad5a033f750bb7c WatchSource:0}: Error finding container 61115c175f64e0af770207eca91aec13cb0fbef5ceb6bdea9ad5a033f750bb7c: Status 404 returned error can't find the container with id 61115c175f64e0af770207eca91aec13cb0fbef5ceb6bdea9ad5a033f750bb7c Jul 02 14:13:04.329710 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:04.329668 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" event={"ID":"6b27ecc8-6761-43c5-a532-2f77f36b3b27","Type":"ContainerStarted","Data":"61115c175f64e0af770207eca91aec13cb0fbef5ceb6bdea9ad5a033f750bb7c"} Jul 02 14:13:06.342526 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:06.342493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" event={"ID":"6b27ecc8-6761-43c5-a532-2f77f36b3b27","Type":"ContainerStarted","Data":"ad2d877e75cdcdfd7a236c17e5a5cd1c086f17362801e0cb1cfdb658000b758a"} Jul 02 14:13:06.370632 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:06.370576 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-p4cdp" podStartSLOduration=1.071673749 podStartE2EDuration="3.370559246s" totalImagesPullingTime="2.298885497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:06.36854897 +0000 UTC m=+711.242534154" watchObservedRunningTime="2026-07-02 14:13:06.370559246 +0000 UTC m=+711.244544430" Jul 02 14:13:45.319072 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.319032 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-67lfn"] Jul 02 14:13:45.322594 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.322569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.323350 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.323328 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8l5cb"] Jul 02 14:13:45.325626 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.325603 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 14:13:45.325787 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.325758 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wkkdb\"" Jul 02 14:13:45.326397 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.326380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.326723 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.326707 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 14:13:45.330415 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.330380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-94c5d\"" Jul 02 14:13:45.335518 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.335499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-67lfn"] Jul 02 14:13:45.345815 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.345793 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8l5cb"] Jul 02 14:13:45.379281 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.379251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.379425 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.379291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfb5\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-kube-api-access-4wfb5\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.379425 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.379326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-kube-api-access-526dj\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.379501 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.379419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-bound-sa-token\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.480490 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.480459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-kube-api-access-526dj\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.480655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.480505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-bound-sa-token\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.480655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.480620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.480735 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.480652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfb5\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-kube-api-access-4wfb5\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.499578 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.499551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-bound-sa-token\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.499787 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.499767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-526dj\" (UniqueName: \"kubernetes.io/projected/fe7b8702-ab5d-4603-80d0-9b2ecfa747ca-kube-api-access-526dj\") pod \"cert-manager-55b4d954d5-8l5cb\" (UID: \"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca\") " pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.500052 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.500033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfb5\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-kube-api-access-4wfb5\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.500944 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.500923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917fbce6-8576-41db-acdb-363f018699f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-67lfn\" (UID: \"917fbce6-8576-41db-acdb-363f018699f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.633346 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.633266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:45.640150 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.640129 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8l5cb" Jul 02 14:13:45.774822 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.774790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-67lfn"] Jul 02 14:13:45.776875 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:13:45.776844 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod917fbce6_8576_41db_acdb_363f018699f9.slice/crio-95c875d8a1784ad4558a9603036e1eff30f7d8106f3e1c48b0401e46f1a65e71 WatchSource:0}: Error finding container 95c875d8a1784ad4558a9603036e1eff30f7d8106f3e1c48b0401e46f1a65e71: Status 404 returned error can't find the container with id 95c875d8a1784ad4558a9603036e1eff30f7d8106f3e1c48b0401e46f1a65e71 Jul 02 14:13:45.804561 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:45.804537 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8l5cb"] Jul 02 14:13:45.806458 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:13:45.806434 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7b8702_ab5d_4603_80d0_9b2ecfa747ca.slice/crio-1e71526684152904e0dd66fbcdec237f960ef3904782b600b0d760665456b008 WatchSource:0}: Error finding container 1e71526684152904e0dd66fbcdec237f960ef3904782b600b0d760665456b008: Status 404 returned error can't find the container with id 1e71526684152904e0dd66fbcdec237f960ef3904782b600b0d760665456b008 Jul 02 14:13:46.533675 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:46.533635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8l5cb" event={"ID":"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca","Type":"ContainerStarted","Data":"1e71526684152904e0dd66fbcdec237f960ef3904782b600b0d760665456b008"} Jul 02 14:13:46.534911 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:46.534884 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" event={"ID":"917fbce6-8576-41db-acdb-363f018699f9","Type":"ContainerStarted","Data":"95c875d8a1784ad4558a9603036e1eff30f7d8106f3e1c48b0401e46f1a65e71"} Jul 02 14:13:49.552595 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:49.552544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" event={"ID":"917fbce6-8576-41db-acdb-363f018699f9","Type":"ContainerStarted","Data":"2fbdc77ae2e7e03d536865a3e33ffbb11bc4a1871cf51d90eb2bb46c4c1ea016"} Jul 02 14:13:49.552939 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:49.552688 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:13:49.554127 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:49.554106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8l5cb" event={"ID":"fe7b8702-ab5d-4603-80d0-9b2ecfa747ca","Type":"ContainerStarted","Data":"ab451c3731de6180e93ea1a98362f109326c0a1fdcd03382184d77fc2365074d"} Jul 02 14:13:49.569864 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:49.569826 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" podStartSLOduration=0.871310723 podStartE2EDuration="4.569813454s" totalImagesPullingTime="3.698502731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:49.568193084 +0000 UTC m=+754.442178270" watchObservedRunningTime="2026-07-02 14:13:49.569813454 +0000 UTC m=+754.443798638" Jul 02 14:13:49.584374 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:49.584260 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8l5cb" podStartSLOduration=0.909081749 podStartE2EDuration="4.584241366s" totalImagesPullingTime="3.675159617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:49.584050477 +0000 UTC m=+754.458035663" watchObservedRunningTime="2026-07-02 14:13:49.584241366 +0000 UTC m=+754.458226556" Jul 02 14:13:52.819968 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.819933 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:13:52.823254 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.823238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:13:52.825852 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.825827 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 14:13:52.825977 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.825863 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 14:13:52.826873 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.826856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-948sr\"" Jul 02 14:13:52.827016 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.827000 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 14:13:52.832223 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.832203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:13:52.944928 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:52.944897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4jl\" (UniqueName: \"kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl\") pod \"maas-keycloak-0\" (UID: \"0ba21f67-45b5-4894-afae-fc5b4741b56a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:13:53.046433 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:53.046396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4jl\" (UniqueName: \"kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl\") pod \"maas-keycloak-0\" (UID: \"0ba21f67-45b5-4894-afae-fc5b4741b56a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:13:53.056324 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:53.056292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4jl\" (UniqueName: \"kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl\") pod \"maas-keycloak-0\" (UID: \"0ba21f67-45b5-4894-afae-fc5b4741b56a\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:13:53.133948 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:53.133856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:13:53.266564 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:53.266539 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:13:53.268676 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:13:53.268641 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba21f67_45b5_4894_afae_fc5b4741b56a.slice/crio-e31bc6e6d872c6a5f97b4c73fc6435cbf61ff2f157ca40090cea56ea31827494 WatchSource:0}: Error finding container e31bc6e6d872c6a5f97b4c73fc6435cbf61ff2f157ca40090cea56ea31827494: Status 404 returned error can't find the container with id e31bc6e6d872c6a5f97b4c73fc6435cbf61ff2f157ca40090cea56ea31827494 Jul 02 14:13:53.572592 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:53.572556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ba21f67-45b5-4894-afae-fc5b4741b56a","Type":"ContainerStarted","Data":"e31bc6e6d872c6a5f97b4c73fc6435cbf61ff2f157ca40090cea56ea31827494"} Jul 02 14:13:55.560840 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:13:55.560808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-67lfn" Jul 02 14:14:00.616150 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:00.616106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ba21f67-45b5-4894-afae-fc5b4741b56a","Type":"ContainerStarted","Data":"a30f94daf87fb11b895eb5ed4cc836d6d1b0e6e1ebd7442dcbbdae4d6c4d5982"} Jul 02 14:14:00.640472 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:00.640420 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.859226252 podStartE2EDuration="8.640403773s" totalImagesPullingTime="6.781177521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:14:00.638300923 +0000 UTC m=+765.512286106" watchObservedRunningTime="2026-07-02 14:14:00.640403773 +0000 UTC m=+765.514388957" Jul 02 14:14:01.134090 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:01.134030 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 14:14:01.136092 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:01.136043 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:02.135302 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:02.135255 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:03.134801 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:03.134751 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 14:14:03.135240 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:03.135201 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:04.134640 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:04.134587 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:05.135626 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:05.135125 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:06.135419 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:06.135366 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:07.135371 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:07.135315 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:08.134334 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:08.134285 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:09.134603 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:09.134557 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:10.134663 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:10.134607 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:11.134671 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:11.134627 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:12.134531 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:12.134481 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jul 02 14:14:13.227284 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:13.227246 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 14:14:13.241463 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:13.241410 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:14:23.232734 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:23.232705 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 14:14:30.706959 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.706925 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58d65c9b57-z7smx"] Jul 02 14:14:30.715410 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.715390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.722392 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.722375 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 14:14:30.722784 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.722770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kkg5v\"" Jul 02 14:14:30.723010 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.722986 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 14:14:30.748484 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.748461 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58d65c9b57-z7smx"] Jul 02 14:14:30.797811 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.797774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d6xb\" (UniqueName: \"kubernetes.io/projected/d80726eb-74a7-4263-8d2a-99a0555953db-kube-api-access-6d6xb\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.797993 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.797879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d80726eb-74a7-4263-8d2a-99a0555953db-webhook-cert\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.899336 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.899288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d80726eb-74a7-4263-8d2a-99a0555953db-webhook-cert\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.899520 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.899419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d6xb\" (UniqueName: \"kubernetes.io/projected/d80726eb-74a7-4263-8d2a-99a0555953db-kube-api-access-6d6xb\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.901646 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.901618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d80726eb-74a7-4263-8d2a-99a0555953db-webhook-cert\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:30.911486 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:30.911464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d6xb\" (UniqueName: \"kubernetes.io/projected/d80726eb-74a7-4263-8d2a-99a0555953db-kube-api-access-6d6xb\") pod \"maas-controller-58d65c9b57-z7smx\" (UID: \"d80726eb-74a7-4263-8d2a-99a0555953db\") " pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:31.025446 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:31.025418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:31.178876 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:31.178846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58d65c9b57-z7smx"] Jul 02 14:14:31.185906 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:14:31.185870 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80726eb_74a7_4263_8d2a_99a0555953db.slice/crio-36875c1447f924a5aeff912a59f969ea9df024d583fb25c103cf1388da59d61a WatchSource:0}: Error finding container 36875c1447f924a5aeff912a59f969ea9df024d583fb25c103cf1388da59d61a: Status 404 returned error can't find the container with id 36875c1447f924a5aeff912a59f969ea9df024d583fb25c103cf1388da59d61a Jul 02 14:14:31.805067 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:31.805030 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d65c9b57-z7smx" event={"ID":"d80726eb-74a7-4263-8d2a-99a0555953db","Type":"ContainerStarted","Data":"36875c1447f924a5aeff912a59f969ea9df024d583fb25c103cf1388da59d61a"} Jul 02 14:14:34.820282 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:34.820245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d65c9b57-z7smx" event={"ID":"d80726eb-74a7-4263-8d2a-99a0555953db","Type":"ContainerStarted","Data":"d71bab5fa2599345ade9a5e84590aa3be06530b95cc8b8838192b2df910df2ce"} Jul 02 14:14:34.820750 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:34.820362 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:45.838798 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:45.838771 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58d65c9b57-z7smx" Jul 02 14:14:45.880818 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:14:45.880752 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58d65c9b57-z7smx" podStartSLOduration=13.293114431 podStartE2EDuration="15.88072973s" totalImagesPullingTime="2.587615299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:14:34.865730907 +0000 UTC m=+799.739716090" watchObservedRunningTime="2026-07-02 14:14:45.88072973 +0000 UTC m=+810.754714917" Jul 02 14:15:06.706007 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.705975 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-hrfsd"] Jul 02 14:15:06.708557 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.708532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.712778 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.712753 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 14:15:06.712890 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.712811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7skh5\"" Jul 02 14:15:06.724350 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.724324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldxc\" (UniqueName: \"kubernetes.io/projected/a6d85fa0-c834-40a5-87e9-48be26253080-kube-api-access-hldxc\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.724476 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.724421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d85fa0-c834-40a5-87e9-48be26253080-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.729212 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.729190 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-hrfsd"] Jul 02 14:15:06.825602 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.825563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldxc\" (UniqueName: \"kubernetes.io/projected/a6d85fa0-c834-40a5-87e9-48be26253080-kube-api-access-hldxc\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.825764 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.825610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d85fa0-c834-40a5-87e9-48be26253080-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.826399 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.826378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d85fa0-c834-40a5-87e9-48be26253080-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:06.836171 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:06.836148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldxc\" (UniqueName: \"kubernetes.io/projected/a6d85fa0-c834-40a5-87e9-48be26253080-kube-api-access-hldxc\") pod \"payload-processing-7bbcb654f4-hrfsd\" (UID: \"a6d85fa0-c834-40a5-87e9-48be26253080\") " pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:07.021865 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:07.021774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:07.170231 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:07.170203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-hrfsd"] Jul 02 14:15:07.172253 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:15:07.172222 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d85fa0_c834_40a5_87e9_48be26253080.slice/crio-44df135e65454cc8895c5a7e5b765c04e98f9a9e4b3d52f4167aa63f107d33a3 WatchSource:0}: Error finding container 44df135e65454cc8895c5a7e5b765c04e98f9a9e4b3d52f4167aa63f107d33a3: Status 404 returned error can't find the container with id 44df135e65454cc8895c5a7e5b765c04e98f9a9e4b3d52f4167aa63f107d33a3 Jul 02 14:15:08.005104 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:08.001960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerStarted","Data":"44df135e65454cc8895c5a7e5b765c04e98f9a9e4b3d52f4167aa63f107d33a3"} Jul 02 14:15:11.019328 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:11.019291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerStarted","Data":"270f15ce51ad8ee36937dd82195ca9449fbbde4fb8be58e58c10ba35463a0f0a"} Jul 02 14:15:11.019709 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:11.019380 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:11.072616 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:11.072554 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" podStartSLOduration=2.189640148 podStartE2EDuration="5.072532711s" totalImagesPullingTime="2.882892563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:15:11.072487643 +0000 UTC m=+835.946472829" watchObservedRunningTime="2026-07-02 14:15:11.072532711 +0000 UTC m=+835.946517897" Jul 02 14:15:15.042247 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.042212 2565 generic.go:356] "Generic (PLEG): container finished" podID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerID="0636ce0035bf246ddf68491c97ff249b13a85cddd4e38e8c17ae8fa48cfad146" exitCode=0 Jul 02 14:15:15.042714 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.042268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" event={"ID":"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3","Type":"ContainerDied","Data":"0636ce0035bf246ddf68491c97ff249b13a85cddd4e38e8c17ae8fa48cfad146"} Jul 02 14:15:15.042714 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.042632 2565 scope.go:117] "RemoveContainer" containerID="0636ce0035bf246ddf68491c97ff249b13a85cddd4e38e8c17ae8fa48cfad146" Jul 02 14:15:15.043614 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.043588 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:15:15.043679 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.043651 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:15:15.043718 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:15.043681 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 14:15:16.048928 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:16.048894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" event={"ID":"4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3","Type":"ContainerStarted","Data":"997773bada4143f808b82655851209e928d205f3e024888d219ecf7296195cd8"} Jul 02 14:15:16.824298 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:16.824246 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:15:16.824655 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:16.824631 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xx9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 02 14:15:16.824708 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:16.824680 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podUID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 02 14:15:17.824493 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:17.824458 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xx9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 02 14:15:17.824956 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:17.824519 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podUID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 02 14:15:18.422933 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:18.422896 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:18.423142 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:18.423117 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" containerID="cri-o://a30f94daf87fb11b895eb5ed4cc836d6d1b0e6e1ebd7442dcbbdae4d6c4d5982" gracePeriod=30 Jul 02 14:15:18.824714 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:18.824678 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xx9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 02 14:15:18.825191 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:18.824733 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podUID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 02 14:15:19.824995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:19.824965 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xx9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 02 14:15:19.825402 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:19.825030 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podUID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 02 14:15:20.071839 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.071804 2565 generic.go:356] "Generic (PLEG): container finished" podID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerID="a30f94daf87fb11b895eb5ed4cc836d6d1b0e6e1ebd7442dcbbdae4d6c4d5982" exitCode=143 Jul 02 14:15:20.072015 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.071873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ba21f67-45b5-4894-afae-fc5b4741b56a","Type":"ContainerDied","Data":"a30f94daf87fb11b895eb5ed4cc836d6d1b0e6e1ebd7442dcbbdae4d6c4d5982"} Jul 02 14:15:20.122849 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.122826 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:20.142542 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.142511 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x4jl\" (UniqueName: \"kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl\") pod \"0ba21f67-45b5-4894-afae-fc5b4741b56a\" (UID: \"0ba21f67-45b5-4894-afae-fc5b4741b56a\") " Jul 02 14:15:20.144949 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.144921 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl" (OuterVolumeSpecName: "kube-api-access-8x4jl") pod "0ba21f67-45b5-4894-afae-fc5b4741b56a" (UID: "0ba21f67-45b5-4894-afae-fc5b4741b56a"). InnerVolumeSpecName "kube-api-access-8x4jl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:15:20.243838 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.243810 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x4jl\" (UniqueName: \"kubernetes.io/projected/0ba21f67-45b5-4894-afae-fc5b4741b56a-kube-api-access-8x4jl\") on node \"ip-10-0-132-214.ec2.internal\" DevicePath \"\"" Jul 02 14:15:20.825418 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.825385 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xx9pd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 02 14:15:20.825823 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:20.825439 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" podUID="4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 02 14:15:21.077689 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.077597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0ba21f67-45b5-4894-afae-fc5b4741b56a","Type":"ContainerDied","Data":"e31bc6e6d872c6a5f97b4c73fc6435cbf61ff2f157ca40090cea56ea31827494"} Jul 02 14:15:21.077689 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.077622 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.077689 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.077666 2565 scope.go:117] "RemoveContainer" containerID="a30f94daf87fb11b895eb5ed4cc836d6d1b0e6e1ebd7442dcbbdae4d6c4d5982" Jul 02 14:15:21.106406 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.106375 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:21.115157 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.115127 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:21.162803 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.162770 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:21.163149 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.163136 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" Jul 02 14:15:21.163149 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.163150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" Jul 02 14:15:21.163295 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.163207 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" containerName="keycloak" Jul 02 14:15:21.165818 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.165803 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.174534 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.174512 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 14:15:21.174670 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.174651 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 14:15:21.177248 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.177232 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 14:15:21.177330 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.177265 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 14:15:21.179287 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.179271 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-948sr\"" Jul 02 14:15:21.190640 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.190611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:21.251996 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.251959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz5sb\" (UniqueName: \"kubernetes.io/projected/f5590852-ac19-4b7b-9d7d-124a14f00569-kube-api-access-fz5sb\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.252199 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.252064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f5590852-ac19-4b7b-9d7d-124a14f00569-test-realms\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.353407 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.353317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f5590852-ac19-4b7b-9d7d-124a14f00569-test-realms\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.353546 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.353411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz5sb\" (UniqueName: \"kubernetes.io/projected/f5590852-ac19-4b7b-9d7d-124a14f00569-kube-api-access-fz5sb\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.354125 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.354068 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f5590852-ac19-4b7b-9d7d-124a14f00569-test-realms\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.368152 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.368125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz5sb\" (UniqueName: \"kubernetes.io/projected/f5590852-ac19-4b7b-9d7d-124a14f00569-kube-api-access-fz5sb\") pod \"maas-keycloak-0\" (UID: \"f5590852-ac19-4b7b-9d7d-124a14f00569\") " pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.475390 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.475347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:21.592805 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.592771 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ba21f67-45b5-4894-afae-fc5b4741b56a" path="/var/lib/kubelet/pods/0ba21f67-45b5-4894-afae-fc5b4741b56a/volumes" Jul 02 14:15:21.629475 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.629403 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 14:15:21.632635 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:15:21.632610 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5590852_ac19_4b7b_9d7d_124a14f00569.slice/crio-7b398560adfabd69f303c1ee1b02c5bae0f9ea9f1da1808e043cfa02281e585a WatchSource:0}: Error finding container 7b398560adfabd69f303c1ee1b02c5bae0f9ea9f1da1808e043cfa02281e585a: Status 404 returned error can't find the container with id 7b398560adfabd69f303c1ee1b02c5bae0f9ea9f1da1808e043cfa02281e585a Jul 02 14:15:21.828748 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.828721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:15:21.829135 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.829110 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:15:21.829742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:21.829725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xx9pd" Jul 02 14:15:22.027199 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:22.027172 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:15:22.083842 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:22.083812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f5590852-ac19-4b7b-9d7d-124a14f00569","Type":"ContainerStarted","Data":"7b398560adfabd69f303c1ee1b02c5bae0f9ea9f1da1808e043cfa02281e585a"} Jul 02 14:15:23.093195 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:23.093141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f5590852-ac19-4b7b-9d7d-124a14f00569","Type":"ContainerStarted","Data":"e99f37621158fc93ef26449ae28df577a2186d9b4c61f2d669a078022f66e24d"} Jul 02 14:15:23.126467 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:23.126408 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.708815372 podStartE2EDuration="2.126388881s" totalImagesPullingTime="417.573509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:15:23.12504337 +0000 UTC m=+847.999028556" watchObservedRunningTime="2026-07-02 14:15:23.126388881 +0000 UTC m=+848.000374065" Jul 02 14:15:23.476566 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:23.476463 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:23.478511 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:23.478464 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:24.476641 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:24.476591 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:25.476065 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:25.476012 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:26.479106 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:26.476189 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:27.477311 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:27.476735 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:28.476690 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:28.476633 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:29.476817 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:29.476759 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:30.476237 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:30.476192 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:31.476316 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:31.476276 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:31.476831 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:31.476607 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:32.476391 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:32.476335 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:33.475940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:33.475888 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:34.475958 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:34.475913 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jul 02 14:15:35.589370 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:35.589341 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 14:15:35.604969 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:35.604930 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f5590852-ac19-4b7b-9d7d-124a14f00569" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:15:45.596032 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:15:45.596001 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 14:16:15.577034 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:15.576956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:16:15.579496 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:15.579473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jq8d2_d47d1c82-5a69-4246-96d9-739b14e54c86/ovn-acl-logging/0.log" Jul 02 14:16:27.301763 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.301729 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r"] Jul 02 14:16:27.306570 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.306548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.310628 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.310603 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9mc7s\"" Jul 02 14:16:27.310763 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.310636 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 14:16:27.310763 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.310607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 14:16:27.310763 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.310607 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 14:16:27.321265 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.321244 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r"] Jul 02 14:16:27.487222 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.487379 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9b46fd-539c-43fa-871c-c31f4524fc16-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.487379 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.487379 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxp8\" (UniqueName: \"kubernetes.io/projected/3e9b46fd-539c-43fa-871c-c31f4524fc16-kube-api-access-fzxp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.487485 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.487485 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.487450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.587972 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.587881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.587972 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.587933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.587972 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.587963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9b46fd-539c-43fa-871c-c31f4524fc16-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588279 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588279 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxp8\" (UniqueName: \"kubernetes.io/projected/3e9b46fd-539c-43fa-871c-c31f4524fc16-kube-api-access-fzxp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588279 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588454 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588454 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588435 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.588559 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.588472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.590228 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.590207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e9b46fd-539c-43fa-871c-c31f4524fc16-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.590499 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.590478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9b46fd-539c-43fa-871c-c31f4524fc16-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.599394 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.599372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxp8\" (UniqueName: \"kubernetes.io/projected/3e9b46fd-539c-43fa-871c-c31f4524fc16-kube-api-access-fzxp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8bb6r\" (UID: \"3e9b46fd-539c-43fa-871c-c31f4524fc16\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.616262 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.616239 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:27.771216 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:27.771185 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r"] Jul 02 14:16:27.771791 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:16:27.771764 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9b46fd_539c_43fa_871c_c31f4524fc16.slice/crio-03ea60fb086f57bcc5e8b629e634c7cf2822e23d062973cc2f815623fb3ba1e5 WatchSource:0}: Error finding container 03ea60fb086f57bcc5e8b629e634c7cf2822e23d062973cc2f815623fb3ba1e5: Status 404 returned error can't find the container with id 03ea60fb086f57bcc5e8b629e634c7cf2822e23d062973cc2f815623fb3ba1e5 Jul 02 14:16:28.463873 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:28.463841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" event={"ID":"3e9b46fd-539c-43fa-871c-c31f4524fc16","Type":"ContainerStarted","Data":"03ea60fb086f57bcc5e8b629e634c7cf2822e23d062973cc2f815623fb3ba1e5"} Jul 02 14:16:31.484356 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:31.484320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" event={"ID":"3e9b46fd-539c-43fa-871c-c31f4524fc16","Type":"ContainerStarted","Data":"7a94cb185d3f4877f31f6072e81e168d824b5c188099bf170a7d5bd309865b57"} Jul 02 14:16:31.517348 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:31.517299 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" podStartSLOduration=1.289639573 podStartE2EDuration="4.517280251s" totalImagesPullingTime="3.227640678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:31.514892055 +0000 UTC m=+916.388877241" watchObservedRunningTime="2026-07-02 14:16:31.517280251 +0000 UTC m=+916.391265436" Jul 02 14:16:37.616504 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:37.616471 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:37.617068 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:37.616527 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:37.629122 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:37.629097 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:38.534164 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:38.534138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8bb6r" Jul 02 14:16:54.491192 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.491159 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg"] Jul 02 14:16:54.494686 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.494667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.497346 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.497328 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 02 14:16:54.504306 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.504284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg"] Jul 02 14:16:54.640432 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.640583 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.640583 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.640583 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9h2\" (UniqueName: \"kubernetes.io/projected/146b7d90-d08b-426b-af5b-5d8a80a9adc4-kube-api-access-jg9h2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.640694 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.640694 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.640615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741306 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741306 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741306 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9h2\" (UniqueName: \"kubernetes.io/projected/146b7d90-d08b-426b-af5b-5d8a80a9adc4-kube-api-access-jg9h2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741573 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741573 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741573 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741712 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741766 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.741928 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.741897 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.744192 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.744167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146b7d90-d08b-426b-af5b-5d8a80a9adc4-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.744712 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.744689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146b7d90-d08b-426b-af5b-5d8a80a9adc4-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.750541 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.750514 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9h2\" (UniqueName: \"kubernetes.io/projected/146b7d90-d08b-426b-af5b-5d8a80a9adc4-kube-api-access-jg9h2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tfhsg\" (UID: \"146b7d90-d08b-426b-af5b-5d8a80a9adc4\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.805459 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.805428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:16:54.939762 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.939725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg"] Jul 02 14:16:54.941041 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:16:54.941013 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146b7d90_d08b_426b_af5b_5d8a80a9adc4.slice/crio-5f278d133b2df09a1e29bcac876f50200b767ffd6a1a17549f615846c9760559 WatchSource:0}: Error finding container 5f278d133b2df09a1e29bcac876f50200b767ffd6a1a17549f615846c9760559: Status 404 returned error can't find the container with id 5f278d133b2df09a1e29bcac876f50200b767ffd6a1a17549f615846c9760559 Jul 02 14:16:54.942423 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:54.942408 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:16:55.605315 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:55.605219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" event={"ID":"146b7d90-d08b-426b-af5b-5d8a80a9adc4","Type":"ContainerStarted","Data":"296af8d4e8c5aad86c8bf983a6e01f28c621c8706bc001f19da55da3ad6714e1"} Jul 02 14:16:55.605315 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:55.605272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" event={"ID":"146b7d90-d08b-426b-af5b-5d8a80a9adc4","Type":"ContainerStarted","Data":"5f278d133b2df09a1e29bcac876f50200b767ffd6a1a17549f615846c9760559"} Jul 02 14:16:55.646413 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:16:55.646365 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" podStartSLOduration=1.256143161 podStartE2EDuration="1.646348983s" totalImagesPullingTime="390.205822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:55.645708295 +0000 UTC m=+940.519693494" watchObservedRunningTime="2026-07-02 14:16:55.646348983 +0000 UTC m=+940.520334166" Jul 02 14:17:04.806241 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:17:04.806207 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:17:04.806638 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:17:04.806271 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:17:04.818710 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:17:04.818677 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:17:05.662627 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:17:05.662595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tfhsg" Jul 02 14:18:03.941511 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:03.941478 2565 generic.go:356] "Generic (PLEG): container finished" podID="a6d85fa0-c834-40a5-87e9-48be26253080" containerID="270f15ce51ad8ee36937dd82195ca9449fbbde4fb8be58e58c10ba35463a0f0a" exitCode=2 Jul 02 14:18:03.941932 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:03.941554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerDied","Data":"270f15ce51ad8ee36937dd82195ca9449fbbde4fb8be58e58c10ba35463a0f0a"} Jul 02 14:18:03.941932 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:03.941853 2565 scope.go:117] "RemoveContainer" containerID="270f15ce51ad8ee36937dd82195ca9449fbbde4fb8be58e58c10ba35463a0f0a" Jul 02 14:18:04.948292 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:04.948262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerStarted","Data":"48a75899a3ae0217c81df1d643a3be22f7857be3e49ab7ee53cc100e74e6e76e"} Jul 02 14:18:04.948779 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:04.948595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:18:15.955686 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:15.955656 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:18:35.954352 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:35.954310 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" podUID="a6d85fa0-c834-40a5-87e9-48be26253080" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.39:9004: connect: connection refused" Jul 02 14:18:36.103037 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:36.102947 2565 generic.go:356] "Generic (PLEG): container finished" podID="a6d85fa0-c834-40a5-87e9-48be26253080" containerID="48a75899a3ae0217c81df1d643a3be22f7857be3e49ab7ee53cc100e74e6e76e" exitCode=2 Jul 02 14:18:36.103037 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:36.103019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerDied","Data":"48a75899a3ae0217c81df1d643a3be22f7857be3e49ab7ee53cc100e74e6e76e"} Jul 02 14:18:36.103241 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:36.103109 2565 scope.go:117] "RemoveContainer" containerID="270f15ce51ad8ee36937dd82195ca9449fbbde4fb8be58e58c10ba35463a0f0a" Jul 02 14:18:36.103449 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:36.103432 2565 scope.go:117] "RemoveContainer" containerID="48a75899a3ae0217c81df1d643a3be22f7857be3e49ab7ee53cc100e74e6e76e" Jul 02 14:18:36.103650 ip-10-0-132-214 kubenswrapper[2565]: E0702 14:18:36.103630 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-hrfsd_openshift-ingress(a6d85fa0-c834-40a5-87e9-48be26253080)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" podUID="a6d85fa0-c834-40a5-87e9-48be26253080" Jul 02 14:18:40.772769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:40.772734 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8cgl6_ba4a744d-d808-4611-9113-af8777867583/manager/0.log" Jul 02 14:18:41.132792 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:41.132706 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58d65c9b57-z7smx_d80726eb-74a7-4263-8d2a-99a0555953db/manager/0.log" Jul 02 14:18:41.244201 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:41.244168 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2rvqd_dd551e39-b49c-4a86-95c4-ada41a8bce2e/server/0.log" Jul 02 14:18:41.363858 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:41.363822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kqgkp_3a2b11f9-7068-443d-a7b6-ac96b1d31310/manager/0.log" Jul 02 14:18:41.602704 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:41.602676 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm_224ca35c-128f-4167-8ab1-e42580e950fa/copy-manifests/0.log" Jul 02 14:18:41.611575 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:41.611542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm_224ca35c-128f-4167-8ab1-e42580e950fa/manager/0.log" Jul 02 14:18:43.319645 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:43.319614 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j7jq4_ac35cfc1-7cb9-4ce9-a9e1-239676ff9358/manager/0.log" Jul 02 14:18:43.427550 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:43.427521 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hqzq_83569746-248e-47e2-86b8-eca5376b82b9/manager/0.log" Jul 02 14:18:43.647308 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:43.647207 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-np8b2_3ca353e0-0c68-41ac-9c16-d0565a158bd5/registry-server/0.log" Jul 02 14:18:43.772769 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:43.772739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mm46q_d130ba3c-23eb-4780-975c-8360fc7ecf09/manager/0.log" Jul 02 14:18:44.009776 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:44.009659 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2649_b0012a43-4fbe-4c77-9593-42630943ff4a/manager/0.log" Jul 02 14:18:44.362529 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:44.362495 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c7l4f_e356078a-15ce-4b56-9940-f57cf265a9c4/istio-proxy/0.log" Jul 02 14:18:44.586406 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:44.586372 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f79d99c4-2xxq6_7ba9e650-5a3c-4ba0-9af1-ca81327733ee/kube-auth-proxy/0.log" Jul 02 14:18:44.817256 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:44.817224 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/1.log" Jul 02 14:18:45.046705 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:45.046670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/1.log" Jul 02 14:18:45.606627 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:45.606597 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8bb6r_3e9b46fd-539c-43fa-871c-c31f4524fc16/main/0.log" Jul 02 14:18:45.939905 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:45.939815 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tfhsg_146b7d90-d08b-426b-af5b-5d8a80a9adc4/main/0.log" Jul 02 14:18:45.954820 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:45.954799 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:18:45.955128 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:45.955114 2565 scope.go:117] "RemoveContainer" containerID="48a75899a3ae0217c81df1d643a3be22f7857be3e49ab7ee53cc100e74e6e76e" Jul 02 14:18:46.158945 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:46.158912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" event={"ID":"a6d85fa0-c834-40a5-87e9-48be26253080","Type":"ContainerStarted","Data":"783aaf26d67cd008840c7044055300eea0ee69f98054802eb678274ec158c5b4"} Jul 02 14:18:46.159142 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:46.159117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:18:53.254185 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:53.254150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7pllm_27ffe1e7-dba8-4b76-9edc-d5f26479136f/global-pull-secret-syncer/0.log" Jul 02 14:18:53.465249 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:53.465213 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zs6cn_063694dc-8ddb-41e9-8b84-a4ebd7c966d7/konnectivity-agent/0.log" Jul 02 14:18:53.488234 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:53.488204 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-214.ec2.internal_4a5c3d13bf76270246373f4c49b89cdc/haproxy/0.log" Jul 02 14:18:57.167625 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:57.167593 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-hrfsd" Jul 02 14:18:58.705925 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:58.705896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j7jq4_ac35cfc1-7cb9-4ce9-a9e1-239676ff9358/manager/0.log" Jul 02 14:18:58.736962 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:58.736932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hqzq_83569746-248e-47e2-86b8-eca5376b82b9/manager/0.log" Jul 02 14:18:58.867189 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:58.867112 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-np8b2_3ca353e0-0c68-41ac-9c16-d0565a158bd5/registry-server/0.log" Jul 02 14:18:58.940011 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:58.939979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mm46q_d130ba3c-23eb-4780-975c-8360fc7ecf09/manager/0.log" Jul 02 14:18:59.002903 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:18:59.002869 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f2649_b0012a43-4fbe-4c77-9593-42630943ff4a/manager/0.log" Jul 02 14:19:00.891199 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:00.891162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-545cb4bcc9-8kxxh_7e20b464-dc22-4a65-af0a-7f49a7eb02a6/metrics-server/0.log" Jul 02 14:19:01.141011 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.140973 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvr4p_dc7ab275-f30a-4d7c-941b-a22621ead3fa/node-exporter/0.log" Jul 02 14:19:01.163232 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.163194 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvr4p_dc7ab275-f30a-4d7c-941b-a22621ead3fa/kube-rbac-proxy/0.log" Jul 02 14:19:01.192522 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.192496 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvr4p_dc7ab275-f30a-4d7c-941b-a22621ead3fa/init-textfile/0.log" Jul 02 14:19:01.336588 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.336545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/prometheus/0.log" Jul 02 14:19:01.363232 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.363201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/config-reloader/0.log" Jul 02 14:19:01.389756 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.389721 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/thanos-sidecar/0.log" Jul 02 14:19:01.415093 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.415054 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/kube-rbac-proxy-web/0.log" Jul 02 14:19:01.440599 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.440569 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/kube-rbac-proxy/0.log" Jul 02 14:19:01.473698 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.473644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/kube-rbac-proxy-thanos/0.log" Jul 02 14:19:01.502260 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:01.502227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0f3f356f-eaee-4769-9b13-9687e6164a9e/init-config-reloader/0.log" Jul 02 14:19:03.283695 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.283665 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58"] Jul 02 14:19:03.287243 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.287226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.305118 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.305095 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4dpz\"/\"kube-root-ca.crt\"" Jul 02 14:19:03.305254 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.305095 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n4dpz\"/\"openshift-service-ca.crt\"" Jul 02 14:19:03.316552 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.316529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n4dpz\"/\"default-dockercfg-qzzxb\"" Jul 02 14:19:03.345995 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.345967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58"] Jul 02 14:19:03.404051 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.404014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-sys\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.404051 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.404056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrtg9\" (UniqueName: \"kubernetes.io/projected/5e14a7d7-adea-414b-b148-fe55eb3281bb-kube-api-access-lrtg9\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.404293 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.404144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-lib-modules\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.404293 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.404185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-proc\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.404293 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.404223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-podres\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.504880 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-sys\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.504880 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrtg9\" (UniqueName: \"kubernetes.io/projected/5e14a7d7-adea-414b-b148-fe55eb3281bb-kube-api-access-lrtg9\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-lib-modules\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-proc\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504977 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-sys\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.504981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-podres\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.505102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-lib-modules\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.505111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-podres\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.505121 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.505066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5e14a7d7-adea-414b-b148-fe55eb3281bb-proc\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.513617 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.513590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrtg9\" (UniqueName: \"kubernetes.io/projected/5e14a7d7-adea-414b-b148-fe55eb3281bb-kube-api-access-lrtg9\") pod \"perf-node-gather-daemonset-xbs58\" (UID: \"5e14a7d7-adea-414b-b148-fe55eb3281bb\") " pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.597202 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.597121 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:03.733913 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:03.733887 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58"] Jul 02 14:19:03.735754 ip-10-0-132-214 kubenswrapper[2565]: W0702 14:19:03.735716 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5e14a7d7_adea_414b_b148_fe55eb3281bb.slice/crio-78b042b132bcfd303149b28e8ddc2b2de4faa5abd2323cc8184400400d3d994d WatchSource:0}: Error finding container 78b042b132bcfd303149b28e8ddc2b2de4faa5abd2323cc8184400400d3d994d: Status 404 returned error can't find the container with id 78b042b132bcfd303149b28e8ddc2b2de4faa5abd2323cc8184400400d3d994d Jul 02 14:19:04.253199 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:04.253164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" event={"ID":"5e14a7d7-adea-414b-b148-fe55eb3281bb","Type":"ContainerStarted","Data":"971d2e59c1b0d5d02e5853071469ff3e83871a23d937e5f5a9237695883d3b23"} Jul 02 14:19:04.253397 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:04.253216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" event={"ID":"5e14a7d7-adea-414b-b148-fe55eb3281bb","Type":"ContainerStarted","Data":"78b042b132bcfd303149b28e8ddc2b2de4faa5abd2323cc8184400400d3d994d"} Jul 02 14:19:04.253397 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:04.253272 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:04.270847 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:04.270793 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" podStartSLOduration=1.270777119 podStartE2EDuration="1.270777119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:19:04.268472593 +0000 UTC m=+1069.142457802" watchObservedRunningTime="2026-07-02 14:19:04.270777119 +0000 UTC m=+1069.144762354" Jul 02 14:19:06.163964 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:06.163936 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8v9qr_468ce41d-4e3c-4e90-8bc7-b00bc2236367/dns/0.log" Jul 02 14:19:06.185541 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:06.185513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8v9qr_468ce41d-4e3c-4e90-8bc7-b00bc2236367/kube-rbac-proxy/0.log" Jul 02 14:19:06.206880 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:06.206845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bjt68_f238319d-82a3-424e-9201-cf2461feecde/dns-node-resolver/0.log" Jul 02 14:19:06.778618 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:06.778584 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d75b9f65d-96xr6_a16123c8-3171-41d3-ba1d-2fa2ebf7c49c/registry/0.log" Jul 02 14:19:06.827940 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:06.827904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7zt7_5539e66f-0564-48fc-8ba2-0cf8cc902e64/node-ca/0.log" Jul 02 14:19:07.793421 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:07.793395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c7l4f_e356078a-15ce-4b56-9940-f57cf265a9c4/istio-proxy/0.log" Jul 02 14:19:07.876126 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:07.876098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f79d99c4-2xxq6_7ba9e650-5a3c-4ba0-9af1-ca81327733ee/kube-auth-proxy/0.log" Jul 02 14:19:07.945996 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:07.945962 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/1.log" Jul 02 14:19:07.946512 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:07.946488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/0.log" Jul 02 14:19:08.012905 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:08.012832 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/2.log" Jul 02 14:19:08.014034 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:08.014011 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/1.log" Jul 02 14:19:08.727868 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:08.727837 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rskpz_73e481ff-00ad-4387-8681-b7a27251472a/serve-healthcheck-canary/0.log" Jul 02 14:19:09.527372 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:09.527335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-splww_835bdb88-f038-42f2-ae8d-6c4070dfeea8/kube-rbac-proxy/0.log" Jul 02 14:19:09.547417 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:09.547388 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-splww_835bdb88-f038-42f2-ae8d-6c4070dfeea8/exporter/0.log" Jul 02 14:19:09.568404 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:09.568378 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-splww_835bdb88-f038-42f2-ae8d-6c4070dfeea8/extractor/0.log" Jul 02 14:19:10.268254 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:10.268227 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n4dpz/perf-node-gather-daemonset-xbs58" Jul 02 14:19:11.799742 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:11.799698 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8cgl6_ba4a744d-d808-4611-9113-af8777867583/manager/0.log" Jul 02 14:19:11.906092 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:11.906056 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58d65c9b57-z7smx_d80726eb-74a7-4263-8d2a-99a0555953db/manager/0.log" Jul 02 14:19:11.927617 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:11.927590 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2rvqd_dd551e39-b49c-4a86-95c4-ada41a8bce2e/server/0.log" Jul 02 14:19:11.996778 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:11.996726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kqgkp_3a2b11f9-7068-443d-a7b6-ac96b1d31310/manager/0.log" Jul 02 14:19:12.124909 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:12.124882 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm_224ca35c-128f-4167-8ab1-e42580e950fa/manager/0.log" Jul 02 14:19:12.146735 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:12.146709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbb7d6f6b-bbtxm_224ca35c-128f-4167-8ab1-e42580e950fa/copy-manifests/0.log" Jul 02 14:19:13.534425 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.534389 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c7l4f_e356078a-15ce-4b56-9940-f57cf265a9c4/istio-proxy/0.log" Jul 02 14:19:13.612645 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.612616 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f79d99c4-2xxq6_7ba9e650-5a3c-4ba0-9af1-ca81327733ee/kube-auth-proxy/0.log" Jul 02 14:19:13.694733 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.694687 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/1.log" Jul 02 14:19:13.695038 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.695022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/0.log" Jul 02 14:19:13.761154 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.761102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/2.log" Jul 02 14:19:13.762161 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:13.762129 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/1.log" Jul 02 14:19:14.867610 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:14.867507 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c7l4f_e356078a-15ce-4b56-9940-f57cf265a9c4/istio-proxy/0.log" Jul 02 14:19:14.918812 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:14.918782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65f79d99c4-2xxq6_7ba9e650-5a3c-4ba0-9af1-ca81327733ee/kube-auth-proxy/0.log" Jul 02 14:19:14.974369 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:14.974334 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/1.log" Jul 02 14:19:14.974758 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:14.974740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xx9pd_4bb410f9-ae1a-44e5-ba2c-a0dedd49f5c3/istio-proxy/0.log" Jul 02 14:19:15.013126 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:15.013038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/2.log" Jul 02 14:19:15.014152 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:15.014110 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-hrfsd_a6d85fa0-c834-40a5-87e9-48be26253080/payload-processing/1.log" Jul 02 14:19:20.460222 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.460170 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/kube-multus-additional-cni-plugins/0.log" Jul 02 14:19:20.484874 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.484826 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/egress-router-binary-copy/0.log" Jul 02 14:19:20.510585 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.510546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/cni-plugins/0.log" Jul 02 14:19:20.535936 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.535911 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/bond-cni-plugin/0.log" Jul 02 14:19:20.566830 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.566800 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/routeoverride-cni/0.log" Jul 02 14:19:20.597338 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.597306 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/whereabouts-cni-bincopy/0.log" Jul 02 14:19:20.621468 ip-10-0-132-214 kubenswrapper[2565]: I0702 14:19:20.621439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jhdrr_c0b666d5-ecdb-442a-adf9-d5befbfa0723/whereabouts-cni/0.log"