Jun 11 23:29:49.441877 ip-10-0-129-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 23:29:49.441891 ip-10-0-129-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 23:29:49.441901 ip-10-0-129-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 23:29:49.442204 ip-10-0-129-57 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 23:30:00.731560 ip-10-0-129-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 23:30:00.731573 ip-10-0-129-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 444c810d4bff4b70b59e1472646fbad2 -- Jun 11 23:32:25.370376 ip-10-0-129-57 systemd[1]: Starting Kubernetes Kubelet... Jun 11 23:32:25.809371 ip-10-0-129-57 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:25.809371 ip-10-0-129-57 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 23:32:25.809371 ip-10-0-129-57 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:25.809371 ip-10-0-129-57 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 23:32:25.809371 ip-10-0-129-57 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 23:32:25.810227 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.809393 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 23:32:25.815501 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815470 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.815501 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815497 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.815501 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815501 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.815501 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815504 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815509 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815513 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815516 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815519 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815522 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815525 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815528 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815531 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815533 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815537 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815539 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815543 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815546 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815549 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815553 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815557 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815559 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815562 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815564 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.815636 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815567 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815570 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815573 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815575 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815579 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815581 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815584 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815587 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815589 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815592 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815595 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815599 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815603 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815606 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815610 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815614 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815617 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815620 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815622 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.816193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815627 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815630 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815633 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815636 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815638 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815641 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815644 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815646 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815649 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815651 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815654 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815657 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815660 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815662 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815665 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815667 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815670 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815672 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815675 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.816659 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815678 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815680 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815683 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815687 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815689 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815692 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815695 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815699 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815702 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815705 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815708 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815710 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815715 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815718 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815721 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815724 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815727 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815730 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815733 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.817158 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815735 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815738 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815740 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815742 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815745 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815748 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815750 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815753 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815755 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815758 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815760 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815763 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815766 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815769 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815772 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815774 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815777 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.817623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.815780 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817718 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817727 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817730 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817733 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817736 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817740 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817743 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817746 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817749 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817751 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817754 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817756 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817759 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817761 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817765 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817768 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817770 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817773 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817776 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.818053 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817779 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817781 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817784 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817786 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817789 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817791 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817795 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817797 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817800 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817803 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817805 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817808 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817810 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817813 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817816 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817819 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817822 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817825 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817827 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817832 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.818590 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817835 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817838 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817841 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817843 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817846 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817848 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817851 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817854 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817857 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817859 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817862 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817864 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817866 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817869 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817872 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817874 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817878 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817882 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817886 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.819146 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817890 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817893 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817896 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817899 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817901 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817904 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817906 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817911 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817914 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817916 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817919 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817921 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817924 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817928 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817930 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817933 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817936 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817939 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817941 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.819608 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817944 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817946 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817949 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817951 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817954 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817956 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817959 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817961 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817964 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817966 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817969 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817972 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817975 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817978 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817980 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817983 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.817986 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818009 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818013 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.820139 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818016 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818020 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818023 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818466 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818473 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818476 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818479 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818483 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818486 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818489 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818491 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818494 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818497 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818499 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818502 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818505 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818507 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818510 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818512 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818515 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.820611 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818518 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818520 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818523 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818528 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818532 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818535 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818537 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818540 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818542 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818545 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818548 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818550 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818553 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818557 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818559 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818562 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818565 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818567 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818570 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.821119 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818575 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818578 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818580 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818583 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818585 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818588 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818590 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818593 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818599 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818601 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818604 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818607 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818609 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818612 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818615 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818617 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818620 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818622 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818625 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818628 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.821614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818630 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818634 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818637 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818640 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818642 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818645 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818648 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818651 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818653 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818656 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818659 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818661 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818664 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818667 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818670 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818672 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818675 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818677 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818680 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818682 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.822135 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818685 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818687 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818690 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818692 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818696 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818699 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818701 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818703 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818706 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818708 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818713 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818716 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818719 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818722 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818725 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818728 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818731 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818734 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818736 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.822626 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818740 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818743 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.818746 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818823 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818831 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818839 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818844 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818848 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818852 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818856 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818860 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818864 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818867 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818871 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818874 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818878 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818881 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818885 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818891 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818895 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818899 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818907 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818911 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 23:32:25.823109 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818916 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818921 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818925 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818930 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818933 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818937 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818941 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818944 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818947 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818950 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818953 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818956 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818960 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818963 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818967 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818970 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818973 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818977 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818981 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818985 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.818987 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819003 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819007 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819011 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 23:32:25.823654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819014 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819017 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819020 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819023 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819026 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819029 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819032 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819035 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819037 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819040 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819044 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819047 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819054 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819057 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819060 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819063 2581 flags.go:64] FLAG: --help="false" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819067 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-57.ec2.internal" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819070 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819073 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819075 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819079 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819082 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819086 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 23:32:25.824315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819088 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819091 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819094 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819098 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819102 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819105 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819108 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819111 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819114 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819117 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819120 2581 flags.go:64] FLAG: --lock-file="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819123 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819125 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819128 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819134 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819137 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819140 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819143 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819146 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819149 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819153 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819158 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819162 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819167 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819172 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 23:32:25.824918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819175 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819178 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819181 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819185 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819187 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819190 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819193 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819202 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819205 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819208 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819211 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819214 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819220 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819223 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819227 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819230 2581 flags.go:64] FLAG: --port="10250" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819233 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819236 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09431d151d4a14741" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819239 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819242 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819245 2581 flags.go:64] FLAG: --register-node="true" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819248 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819252 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819255 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 23:32:25.825551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819258 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819261 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819264 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819267 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819270 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819275 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819283 2581 flags.go:64] FLAG: --runonce="false" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819286 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819289 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819292 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819295 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819298 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819301 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819304 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819307 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819310 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819313 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819316 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819319 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819322 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819325 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819328 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819334 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819337 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819339 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 23:32:25.826155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819344 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819347 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819350 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819353 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819356 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819358 2581 flags.go:64] FLAG: --v="2" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819362 2581 flags.go:64] FLAG: --version="false" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819366 2581 flags.go:64] FLAG: --vmodule="" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819376 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.819379 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819515 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819520 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819524 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819529 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819532 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819535 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819538 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819540 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819543 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819545 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819548 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819551 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.826814 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819553 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819556 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819559 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819561 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819564 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819568 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819573 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819577 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819580 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819583 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819586 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819589 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819591 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819594 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819597 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819599 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819602 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819604 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819607 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.827399 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819609 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819612 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819615 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819618 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819622 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819625 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819627 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819631 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819635 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819637 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819640 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819646 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819648 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819651 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819654 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819657 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819660 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819663 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819665 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.827916 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819668 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819671 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819673 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819676 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819678 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819681 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819684 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819686 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819689 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819692 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819694 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819697 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819699 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819702 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819704 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819707 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819712 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819714 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819717 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819719 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.828434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819722 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819725 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819727 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819730 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819732 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819735 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819738 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819740 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819743 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819746 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819749 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819751 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819754 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819757 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819759 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819762 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819764 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819767 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819769 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819772 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.828928 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819774 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819777 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819779 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819782 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819784 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819787 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819789 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.819792 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.820728 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.828693 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.828717 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.828741 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.828751 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828819 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.829423 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828826 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828829 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828832 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828835 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828837 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828840 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828843 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828845 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828848 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828851 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828853 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828856 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828859 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828861 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828864 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828866 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828869 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828871 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828874 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828876 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.829787 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828879 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828882 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828884 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828887 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828890 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828892 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828895 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828898 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828909 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828912 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828916 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828920 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828923 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828926 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828929 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828932 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828935 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828939 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828942 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.830303 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828945 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828947 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828950 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828953 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828956 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828958 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828962 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828965 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828967 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828970 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828972 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828975 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828978 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828981 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828983 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828986 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.828988 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829005 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829008 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.830766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829012 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829016 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829019 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829028 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829031 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829034 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829036 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829039 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829041 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829044 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829047 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829049 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829052 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829055 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829057 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829060 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829063 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829065 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829068 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.831261 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829070 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829073 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829076 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829078 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829081 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829083 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829086 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829090 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829094 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829096 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829100 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829103 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829106 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829109 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829112 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829115 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829118 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829127 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829131 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829133 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.831805 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829136 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.829141 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829299 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829306 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829309 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829312 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829314 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829317 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829320 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829322 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829325 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829327 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829331 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829335 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 23:32:25.832613 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829338 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829341 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829344 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829346 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829349 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829351 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829354 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829356 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829359 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829361 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829364 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829366 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829369 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829372 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829376 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829379 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829388 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829392 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829395 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 23:32:25.833151 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829398 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829401 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829404 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829407 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829410 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829412 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829415 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829418 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829420 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829423 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829425 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829428 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829431 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829433 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829436 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829438 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829441 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829444 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829446 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829449 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 23:32:25.833623 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829451 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829454 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829456 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829459 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829462 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829464 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829467 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829470 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829472 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829475 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829483 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829486 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829488 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829491 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829493 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829496 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829499 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829501 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829504 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829506 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 23:32:25.834157 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829509 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829511 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829514 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829516 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829519 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829521 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829524 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829527 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829529 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829531 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829534 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829537 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829539 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829541 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829544 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829546 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829549 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829552 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829555 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829557 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 23:32:25.834652 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829560 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829563 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829565 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829573 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829576 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829578 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829581 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:25.829584 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.829589 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.829760 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 23:32:25.835159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.833902 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 23:32:25.835693 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.835677 2581 server.go:1019] "Starting client certificate rotation" Jun 11 23:32:25.835800 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.835780 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:32:25.835835 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.835824 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 23:32:25.838609 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.838591 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:32:25.839854 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.839833 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 23:32:25.862686 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.862666 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 23:32:25.866686 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.866665 2581 log.go:25] "Validated CRI v1 image API" Jun 11 23:32:25.867607 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.867590 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 23:32:25.871562 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.871530 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 eafa5eea-aff4-4be0-9885-a1714a89d685:/dev/nvme0n1p3 eda1204c-4c2a-41d5-8c24-c5df9a78f2ae:/dev/nvme0n1p4] Jun 11 23:32:25.871658 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.871558 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 23:32:25.878251 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.878225 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:32:25.879220 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.879081 2581 manager.go:216] Machine: {Timestamp:2026-06-11 23:32:25.87747357 +0000 UTC m=+0.395639989 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108397 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec272bda331b142bb75f569573c293d2 SystemUUID:ec272bda-331b-142b-b75f-569573c293d2 BootID:444c810d-4bff-4b70-b59e-1472646fbad2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:0c:62:7f:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:0c:62:7f:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:bc:7d:ed:d2:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 23:32:25.879220 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.879203 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 23:32:25.879369 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.879309 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 23:32:25.881455 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.881416 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 23:32:25.881632 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.881467 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 23:32:25.882459 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.882446 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 23:32:25.882503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.882461 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 23:32:25.882503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.882470 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:32:25.883281 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.883268 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 23:32:25.885188 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.885173 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 23:32:25.889948 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.889929 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:32:25.890143 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890132 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 23:32:25.890181 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890170 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 23:32:25.890212 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890194 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 23:32:25.890242 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890227 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 23:32:25.890273 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890242 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 23:32:25.890273 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.890255 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 23:32:25.891080 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.891063 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:32:25.891353 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.891087 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 23:32:25.894479 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.894455 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 23:32:25.896364 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896347 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 23:32:25.896409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896393 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 23:32:25.896641 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896629 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 23:32:25.896691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896648 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 23:32:25.896691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896656 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 23:32:25.896691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896663 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 23:32:25.896691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896671 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 23:32:25.896691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.896677 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 23:32:25.897306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897297 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 23:32:25.897306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897306 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 23:32:25.897361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897313 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 23:32:25.897361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897319 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 23:32:25.897361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897327 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 23:32:25.897361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.897335 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 23:32:25.898304 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.898292 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 23:32:25.898341 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.898305 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 23:32:25.899488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.899467 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grx5z" Jun 11 23:32:25.900009 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.899973 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 23:32:25.900603 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.900571 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 23:32:25.900703 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.900567 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 23:32:25.901847 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.901833 2581 server.go:1268] "Started kubelet" Jun 11 23:32:25.901927 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.901895 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 23:32:25.902107 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.902021 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 23:32:25.902212 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.902130 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 23:32:25.902692 ip-10-0-129-57 systemd[1]: Started Kubernetes Kubelet. Jun 11 23:32:25.904233 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.904213 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 23:32:25.904628 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.904617 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 23:32:25.908318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.908297 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-grx5z" Jun 11 23:32:25.910957 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.910931 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 23:32:25.914069 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914043 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 23:32:25.914232 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914100 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 23:32:25.914232 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.914189 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:25.914884 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914855 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 23:32:25.914884 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914874 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 23:32:25.915044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914854 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 23:32:25.915044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.914981 2581 factory.go:55] Registering systemd factory Jun 11 23:32:25.915044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915011 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 23:32:25.915163 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915068 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 23:32:25.915163 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915079 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 23:32:25.915440 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915291 2581 factory.go:153] Registering CRI-O factory Jun 11 23:32:25.915522 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915443 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 23:32:25.915573 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915561 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 23:32:25.915609 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915594 2581 factory.go:103] Registering Raw factory Jun 11 23:32:25.915640 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.915612 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 23:32:25.916157 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.916143 2581 manager.go:349] Starting recovery of all containers Jun 11 23:32:25.916573 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.916545 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 23:32:25.917742 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.916474 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-57.ec2.internal.18b82ad4c20882cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-57.ec2.internal,UID:ip-10-0-129-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-57.ec2.internal,},FirstTimestamp:2026-06-11 23:32:25.901802189 +0000 UTC m=+0.419968607,LastTimestamp:2026-06-11 23:32:25.901802189 +0000 UTC m=+0.419968607,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-57.ec2.internal,}" Jun 11 23:32:25.929259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.929238 2581 manager.go:354] Recovery completed Jun 11 23:32:25.929388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.929282 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:25.934019 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.933982 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:25.937105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937083 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:25.937190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937121 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:25.937190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937132 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:25.937704 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937687 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 23:32:25.937771 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937704 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 23:32:25.937771 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937694 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:25.937771 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.937727 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 23:32:25.938732 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.938718 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:25.938777 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.938747 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:25.938777 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.938757 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:25.939962 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.939946 2581 policy_none.go:49] "None policy: Start" Jun 11 23:32:25.939962 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.939963 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 23:32:25.940129 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.939973 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 23:32:25.942079 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.942066 2581 policy_none.go:47] "Start" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.974519 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.975815 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.975850 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.975874 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.975917 2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.977847 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.977889 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.977902 2581 server.go:87] "Starting device plugin registration server" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.977964 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.978266 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.978280 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.978360 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.978456 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:25.978466 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.979021 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 23:32:25.985125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:25.979074 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.077202 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.076029 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal"] Jun 11 23:32:26.077350 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.077211 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:26.078775 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.078761 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:26.079554 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.079537 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:26.079653 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.079568 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:26.079653 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.079581 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:26.079653 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.079612 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.080088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.080071 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:26.080147 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.080104 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:26.080147 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.080115 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:26.082374 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.082361 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:26.082490 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.082473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.082546 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.082507 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:26.083308 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083290 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:26.083385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083321 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:26.083385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083333 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:26.083385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083292 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:26.083497 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083397 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:26.083497 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.083408 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:26.085653 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.085636 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.085691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.085678 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 23:32:26.086612 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.086598 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientMemory" Jun 11 23:32:26.086692 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.086630 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 23:32:26.086692 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.086642 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeHasSufficientPID" Jun 11 23:32:26.089122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.089109 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.089170 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.089139 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-57.ec2.internal\": node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.104534 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.104503 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.107947 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.107927 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-57.ec2.internal\" not found" node="ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.112622 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.112600 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-57.ec2.internal\" not found" node="ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.116961 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.116931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f356dd6ea2b82bf8308e8edc1842431d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-57.ec2.internal\" (UID: \"f356dd6ea2b82bf8308e8edc1842431d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.117094 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.116973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.117094 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.117023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.205480 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.205447 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.217186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.217297 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.217297 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f356dd6ea2b82bf8308e8edc1842431d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-57.ec2.internal\" (UID: \"f356dd6ea2b82bf8308e8edc1842431d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.217297 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.217297 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf49238986804a8be3077ac528abb023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal\" (UID: \"cf49238986804a8be3077ac528abb023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.217441 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.217257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f356dd6ea2b82bf8308e8edc1842431d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-57.ec2.internal\" (UID: \"f356dd6ea2b82bf8308e8edc1842431d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.306030 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.305982 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.406890 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.406799 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.410990 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.410968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.417296 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.417270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:26.507289 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.507241 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.607783 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.607747 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.708429 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.708331 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.809072 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.809028 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.835190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.834830 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 23:32:26.835190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.835067 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:32:26.835190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.835131 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 23:32:26.910680 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:26.909706 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:26.914513 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.914448 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:27:25 +0000 UTC" deadline="2028-02-06 05:31:16.155597496 +0000 UTC" Jun 11 23:32:26.914513 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.914508 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14501h58m49.241094307s" Jun 11 23:32:26.947457 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:26.947349 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf49238986804a8be3077ac528abb023.slice/crio-d1453991304243418551648cc11e96dac3c53726f6f8e44cdb25c009dce7962f WatchSource:0}: Error finding container d1453991304243418551648cc11e96dac3c53726f6f8e44cdb25c009dce7962f: Status 404 returned error can't find the container with id d1453991304243418551648cc11e96dac3c53726f6f8e44cdb25c009dce7962f Jun 11 23:32:26.950603 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:26.950571 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf356dd6ea2b82bf8308e8edc1842431d.slice/crio-0af6411d7f6b2dfa38e51d0b67f26f5a7e908df22ba6a70061782c3f34c06fa4 WatchSource:0}: Error finding container 0af6411d7f6b2dfa38e51d0b67f26f5a7e908df22ba6a70061782c3f34c06fa4: Status 404 returned error can't find the container with id 0af6411d7f6b2dfa38e51d0b67f26f5a7e908df22ba6a70061782c3f34c06fa4 Jun 11 23:32:26.953923 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.953906 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:32:26.979599 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.979496 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" event={"ID":"f356dd6ea2b82bf8308e8edc1842431d","Type":"ContainerStarted","Data":"0af6411d7f6b2dfa38e51d0b67f26f5a7e908df22ba6a70061782c3f34c06fa4"} Jun 11 23:32:26.980531 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:26.980508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" event={"ID":"cf49238986804a8be3077ac528abb023","Type":"ContainerStarted","Data":"d1453991304243418551648cc11e96dac3c53726f6f8e44cdb25c009dce7962f"} Jun 11 23:32:27.010567 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.010541 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:27.012770 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.012752 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:27.111356 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.111320 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:27.211902 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.211850 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-57.ec2.internal\" not found" Jun 11 23:32:27.300955 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.300872 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:27.314568 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.314531 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" Jun 11 23:32:27.326386 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.326353 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:32:27.327749 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.327716 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" Jun 11 23:32:27.334330 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.334292 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 23:32:27.726101 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.726022 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:27.752959 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.752929 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 23:32:27.891824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.891787 2581 apiserver.go:52] "Watching apiserver" Jun 11 23:32:27.900156 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.900127 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 23:32:27.900619 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.900591 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal","openshift-multus/multus-dhl2k","openshift-ovn-kubernetes/ovnkube-node-mcddd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5","openshift-cluster-node-tuning-operator/tuned-fc7fx","openshift-dns/node-resolver-lc6mf","openshift-image-registry/node-ca-28dsp","openshift-multus/multus-additional-cni-plugins-hlr25","openshift-multus/network-metrics-daemon-wz62w","openshift-network-diagnostics/network-check-target-qhmzc","openshift-network-operator/iptables-alerter-dzwvt","kube-system/global-pull-secret-syncer-8dxmb","kube-system/konnectivity-agent-xzdh5"] Jun 11 23:32:27.903113 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.903091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:27.905431 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.905411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:27.905553 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.905506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:27.907547 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.907524 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.907664 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.907646 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9vfbt\"" Jun 11 23:32:27.907778 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.907646 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.907778 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.907710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.910124 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.910103 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.912255 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.912235 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.912361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.912340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 23:32:27.912463 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.912448 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54kq9\"" Jun 11 23:32:27.912511 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.912482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.912938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.912917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7x5bt\"" Jun 11 23:32:27.913021 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.913009 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.914127 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.914111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 23:32:27.914261 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.914242 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 23:32:27.914781 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.914764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.915110 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 23:32:27.915204 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915159 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 23:32:27.915266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915204 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.915266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915231 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.915371 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 23:32:27.918433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.915769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 23:32:27.918433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.916763 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzjwd\"" Jun 11 23:32:27.918433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.918282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 23:32:27.918776 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.918756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.920163 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.920141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zrbg\"" Jun 11 23:32:27.920250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.920193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.920288 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.920145 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.920409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.920390 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.920821 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.920801 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.921335 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.921315 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 23:32:27.921858 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.921634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:27.921858 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.921777 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hksr\"" Jun 11 23:32:27.922032 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.921966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 23:32:27.924126 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.924104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:27.925708 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-kubelet\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.925824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-log-socket\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.925876 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.925876 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-os-release\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.925977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cnibin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.925977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-etc-kubernetes\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.925977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925931 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 23:32:27.925977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-node-log\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.925977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-env-overrides\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.925980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jfhgg\"" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovn-node-metrics-cert\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-lib-modules\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-multus-certs\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-hosts-file\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-kubelet-config\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:27.926236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-systemd\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-system-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-k8s-cni-cncf-io\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-modprobe-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-systemd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926370 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysconfig\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cni-binary-copy\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-netns\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-script-lib\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-registration-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.926610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-multus\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-conf-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-device-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-run\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt92n\" (UniqueName: \"kubernetes.io/projected/65bdc258-8964-4843-be10-4215f970ae4f-kube-api-access-gt92n\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbnl\" (UniqueName: \"kubernetes.io/projected/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-kube-api-access-fsbnl\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-kubelet\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-slash\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-socket-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-tuned\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-daemon-config\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twvdl\" (UniqueName: \"kubernetes.io/projected/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-kube-api-access-twvdl\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-ovn\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.926984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-bin\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.927318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-system-cni-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-netns\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-sys-fs\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-dbus\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-kubernetes\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-tmp\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvxc\" (UniqueName: \"kubernetes.io/projected/8b226d41-e48f-406b-ba8a-253c32d9520c-kube-api-access-6qvxc\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.927291 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927160 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-etc-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-netd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-config\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-conf\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-sys\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-var-lib-kubelet\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-cnibin\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-os-release\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-socket-dir-parent\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-var-lib-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmxps\" (UniqueName: \"kubernetes.io/projected/0f795df2-f0c8-475f-bf8a-6077d310a6d6-kube-api-access-nmxps\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-tmp-dir\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-host\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-bin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-hostroot\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.927973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-systemd-units\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:27.928938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.928025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlxjx\" (UniqueName: \"kubernetes.io/projected/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kube-api-access-nlxjx\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:27.929620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.929152 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 23:32:27.929620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.929321 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5rkv\"" Jun 11 23:32:27.929620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.929325 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.929620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.929493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:27.929620 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:27.929605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:27.931850 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.931831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:27.936523 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.936503 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:32:27.936758 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.936737 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jftt2\"" Jun 11 23:32:27.937028 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.937012 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 23:32:27.937126 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.937032 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 23:32:27.950485 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.950461 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 23:32:27.972082 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.972053 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fxxdx" Jun 11 23:32:27.981185 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:27.981107 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fxxdx" Jun 11 23:32:28.017241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.017208 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 23:32:28.028729 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-ovn\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028729 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-bin\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-system-cni-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-netns\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-sys-fs\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-bin\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028874 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-system-cni-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028887 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-netns\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-dbus\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028808 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-ovn\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028927 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-sys-fs\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.028970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-kubernetes\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-tmp\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.028987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-dbus\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvxc\" (UniqueName: \"kubernetes.io/projected/8b226d41-e48f-406b-ba8a-253c32d9520c-kube-api-access-6qvxc\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-kubernetes\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-etc-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-netd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-config\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029167 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-conf\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-sys\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-var-lib-kubelet\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029229 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-etc-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-cnibin\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.029388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-os-release\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-socket-dir-parent\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029333 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysctl-conf\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029337 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-var-lib-kubelet\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-var-lib-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029367 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmxps\" (UniqueName: \"kubernetes.io/projected/0f795df2-f0c8-475f-bf8a-6077d310a6d6-kube-api-access-nmxps\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029371 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029386 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-sys\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-tmp-dir\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-host\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-os-release\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-socket-dir-parent\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-cnibin\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029207 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-cni-netd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-bin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-hostroot\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-systemd-units\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.030323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlxjx\" (UniqueName: \"kubernetes.io/projected/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kube-api-access-nlxjx\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-kubelet\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-log-socket\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-var-lib-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029690 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4af38d7d-27be-44d5-ab3f-49e844cca6e8-agent-certs\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-hostroot\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p847k\" (UniqueName: \"kubernetes.io/projected/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-kube-api-access-p847k\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-os-release\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-systemd-units\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-tmp-dir\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cnibin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-host\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.031122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-etc-kubernetes\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-node-log\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-etc-kubernetes\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-kubelet\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-log-socket\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.029986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-node-log\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cnibin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-bin\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030047 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65bdc258-8964-4843-be10-4215f970ae4f-os-release\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-env-overrides\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovn-node-metrics-cert\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030102 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-config\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-lib-modules\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-multus-certs\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-hosts-file\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-kubelet-config\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-systemd\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-multus-certs\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.031903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030255 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-lib-modules\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030294 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-systemd\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-hosts-file\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a989c7a8-9435-4d21-ae43-65ddc247ea13-kubelet-config\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfkq\" (UniqueName: \"kubernetes.io/projected/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-kube-api-access-pjfkq\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-system-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrg2\" (UniqueName: \"kubernetes.io/projected/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-kube-api-access-ckrg2\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-k8s-cni-cncf-io\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-system-cni-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-modprobe-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-k8s-cni-cncf-io\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-iptables-alerter-script\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-systemd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-env-overrides\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030601 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-modprobe-d\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.032815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysconfig\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-systemd\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cni-binary-copy\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030695 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-sysconfig\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-netns\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-script-lib\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-run-openvswitch\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-registration-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030876 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-run-netns\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-host\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-multus\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030932 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-conf-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.033639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.030983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-device-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031055 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-run\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-serviceca\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-registration-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4af38d7d-27be-44d5-ab3f-49e844cca6e8-konnectivity-ca\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt92n\" (UniqueName: \"kubernetes.io/projected/65bdc258-8964-4843-be10-4215f970ae4f-kube-api-access-gt92n\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031165 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-cni-multus\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbnl\" (UniqueName: \"kubernetes.io/projected/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-kube-api-access-fsbnl\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031203 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-conf-dir\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-host-slash\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-kubelet\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-slash\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-socket-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.034488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-tuned\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-cni-binary-copy\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-daemon-config\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.031379 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twvdl\" (UniqueName: \"kubernetes.io/projected/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-kube-api-access-twvdl\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031434 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovnkube-script-lib\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.031456 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:28.53143664 +0000 UTC m=+3.049603073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031597 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b226d41-e48f-406b-ba8a-253c32d9520c-run\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031662 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65bdc258-8964-4843-be10-4215f970ae4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-host-var-lib-kubelet\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031687 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-device-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03e0fcbc-ac2c-439d-933c-a5b3a316c789-socket-dir\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.031728 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f795df2-f0c8-475f-bf8a-6077d310a6d6-host-slash\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.032125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-multus-daemon-config\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.032909 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-tmp\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.033076 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f795df2-f0c8-475f-bf8a-6077d310a6d6-ovn-node-metrics-cert\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.035306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.033831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b226d41-e48f-406b-ba8a-253c32d9520c-etc-tuned\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.041397 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.041354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlxjx\" (UniqueName: \"kubernetes.io/projected/03e0fcbc-ac2c-439d-933c-a5b3a316c789-kube-api-access-nlxjx\") pod \"aws-ebs-csi-driver-node-fzrw5\" (UID: \"03e0fcbc-ac2c-439d-933c-a5b3a316c789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.041597 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.041502 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvxc\" (UniqueName: \"kubernetes.io/projected/8b226d41-e48f-406b-ba8a-253c32d9520c-kube-api-access-6qvxc\") pod \"tuned-fc7fx\" (UID: \"8b226d41-e48f-406b-ba8a-253c32d9520c\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.041728 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.041710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmxps\" (UniqueName: \"kubernetes.io/projected/0f795df2-f0c8-475f-bf8a-6077d310a6d6-kube-api-access-nmxps\") pod \"ovnkube-node-mcddd\" (UID: \"0f795df2-f0c8-475f-bf8a-6077d310a6d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.042048 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.042024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt92n\" (UniqueName: \"kubernetes.io/projected/65bdc258-8964-4843-be10-4215f970ae4f-kube-api-access-gt92n\") pod \"multus-additional-cni-plugins-hlr25\" (UID: \"65bdc258-8964-4843-be10-4215f970ae4f\") " pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.042709 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.042688 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbnl\" (UniqueName: \"kubernetes.io/projected/4407d7ce-2aa6-42f1-a78b-fd9b53df679f-kube-api-access-fsbnl\") pod \"node-resolver-lc6mf\" (UID: \"4407d7ce-2aa6-42f1-a78b-fd9b53df679f\") " pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.043283 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.043262 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twvdl\" (UniqueName: \"kubernetes.io/projected/59713dcc-1c3b-44c0-ad1f-037e1b9a1679-kube-api-access-twvdl\") pod \"multus-dhl2k\" (UID: \"59713dcc-1c3b-44c0-ad1f-037e1b9a1679\") " pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.131701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.131701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:28.131938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4af38d7d-27be-44d5-ab3f-49e844cca6e8-agent-certs\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.131938 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.131822 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:28.131938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p847k\" (UniqueName: \"kubernetes.io/projected/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-kube-api-access-p847k\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.131938 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.131898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:28.631876852 +0000 UTC m=+3.150043278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:28.131938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfkq\" (UniqueName: \"kubernetes.io/projected/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-kube-api-access-pjfkq\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrg2\" (UniqueName: \"kubernetes.io/projected/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-kube-api-access-ckrg2\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.131986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-iptables-alerter-script\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-host\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-serviceca\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4af38d7d-27be-44d5-ab3f-49e844cca6e8-konnectivity-ca\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.132200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-host-slash\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.132418 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132248 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-host\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.132418 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-host-slash\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.132815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-serviceca\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.132815 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4af38d7d-27be-44d5-ab3f-49e844cca6e8-konnectivity-ca\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.132983 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.132825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-iptables-alerter-script\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.134776 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.134750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4af38d7d-27be-44d5-ab3f-49e844cca6e8-agent-certs\") pod \"konnectivity-agent-xzdh5\" (UID: \"4af38d7d-27be-44d5-ab3f-49e844cca6e8\") " pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.139643 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.139607 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:28.139643 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.139633 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:28.139643 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.139648 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:28.139896 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.139711 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:28.639693561 +0000 UTC m=+3.157859985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:28.142030 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.141980 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfkq\" (UniqueName: \"kubernetes.io/projected/d5c843f9-c6f0-49ac-8e2d-73d6b695e26c-kube-api-access-pjfkq\") pod \"iptables-alerter-dzwvt\" (UID: \"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c\") " pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.142502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.142481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrg2\" (UniqueName: \"kubernetes.io/projected/3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b-kube-api-access-ckrg2\") pod \"node-ca-28dsp\" (UID: \"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b\") " pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.143232 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.143213 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p847k\" (UniqueName: \"kubernetes.io/projected/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-kube-api-access-p847k\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.214436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.214400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lc6mf" Jun 11 23:32:28.223491 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.223458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhl2k" Jun 11 23:32:28.231509 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.231439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:28.238364 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.238338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" Jun 11 23:32:28.245345 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.245310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" Jun 11 23:32:28.251385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.251359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlr25" Jun 11 23:32:28.258220 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.258190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:28.265312 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.265285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28dsp" Jun 11 23:32:28.271291 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.271269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dzwvt" Jun 11 23:32:28.535257 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.535126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:28.535426 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.535278 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:28.535426 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.535377 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:29.535355459 +0000 UTC m=+4.053521894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:28.636119 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.636083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.636285 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.636227 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:28.636356 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.636299 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:29.636280064 +0000 UTC m=+4.154446484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:28.736615 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.736559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:28.736810 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.736763 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:28.736810 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.736790 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:28.736810 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.736805 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:28.736963 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.736945 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:29.736922624 +0000 UTC m=+4.255089046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:28.808017 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.807834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b226d41_e48f_406b_ba8a_253c32d9520c.slice/crio-4ec145022a5044deba9a52ec2282bddb2efb76a451f76facedbfcdaaf3be8310 WatchSource:0}: Error finding container 4ec145022a5044deba9a52ec2282bddb2efb76a451f76facedbfcdaaf3be8310: Status 404 returned error can't find the container with id 4ec145022a5044deba9a52ec2282bddb2efb76a451f76facedbfcdaaf3be8310 Jun 11 23:32:28.809096 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.809065 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4407d7ce_2aa6_42f1_a78b_fd9b53df679f.slice/crio-e12ef1ee11cc53bacd0336601d9f852bdfb662a44d98fbeaddcc322c61d1a3d3 WatchSource:0}: Error finding container e12ef1ee11cc53bacd0336601d9f852bdfb662a44d98fbeaddcc322c61d1a3d3: Status 404 returned error can't find the container with id e12ef1ee11cc53bacd0336601d9f852bdfb662a44d98fbeaddcc322c61d1a3d3 Jun 11 23:32:28.811359 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.811314 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e0fcbc_ac2c_439d_933c_a5b3a316c789.slice/crio-94677359984b68f2596d96ac6a51029653aaa3b679fe3b8e772079a8443eac4b WatchSource:0}: Error finding container 94677359984b68f2596d96ac6a51029653aaa3b679fe3b8e772079a8443eac4b: Status 404 returned error can't find the container with id 94677359984b68f2596d96ac6a51029653aaa3b679fe3b8e772079a8443eac4b Jun 11 23:32:28.811948 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.811922 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af38d7d_27be_44d5_ab3f_49e844cca6e8.slice/crio-98ddc9c12c045e565e62a90152074897c99343e8c7d857b511c9b1f81bf140cd WatchSource:0}: Error finding container 98ddc9c12c045e565e62a90152074897c99343e8c7d857b511c9b1f81bf140cd: Status 404 returned error can't find the container with id 98ddc9c12c045e565e62a90152074897c99343e8c7d857b511c9b1f81bf140cd Jun 11 23:32:28.812803 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.812747 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f795df2_f0c8_475f_bf8a_6077d310a6d6.slice/crio-59e84cd50ae2058902e1a015179064441b81f148d70147f0c800a10d62224d2b WatchSource:0}: Error finding container 59e84cd50ae2058902e1a015179064441b81f148d70147f0c800a10d62224d2b: Status 404 returned error can't find the container with id 59e84cd50ae2058902e1a015179064441b81f148d70147f0c800a10d62224d2b Jun 11 23:32:28.815102 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.815071 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8a620d_ac03_4c6a_b58f_cbd5a15a4d2b.slice/crio-953e4c00509ad39c64e6c0d72b81097b07bfddda7e0e1fab959d719d252e62d6 WatchSource:0}: Error finding container 953e4c00509ad39c64e6c0d72b81097b07bfddda7e0e1fab959d719d252e62d6: Status 404 returned error can't find the container with id 953e4c00509ad39c64e6c0d72b81097b07bfddda7e0e1fab959d719d252e62d6 Jun 11 23:32:28.816040 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.815985 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bdc258_8964_4843_be10_4215f970ae4f.slice/crio-39807e085db2f25f7ad8cc7f4351edacd97414c90affa3c8a77077f8379f46a8 WatchSource:0}: Error finding container 39807e085db2f25f7ad8cc7f4351edacd97414c90affa3c8a77077f8379f46a8: Status 404 returned error can't find the container with id 39807e085db2f25f7ad8cc7f4351edacd97414c90affa3c8a77077f8379f46a8 Jun 11 23:32:28.818180 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.818158 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c843f9_c6f0_49ac_8e2d_73d6b695e26c.slice/crio-69321952062eb0d78ad86019739cbb74214727dc5b3158425e763f8474146029 WatchSource:0}: Error finding container 69321952062eb0d78ad86019739cbb74214727dc5b3158425e763f8474146029: Status 404 returned error can't find the container with id 69321952062eb0d78ad86019739cbb74214727dc5b3158425e763f8474146029 Jun 11 23:32:28.820193 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:32:28.820169 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59713dcc_1c3b_44c0_ad1f_037e1b9a1679.slice/crio-f5e33d2bab70dd942673d1817d8258527a00b92d47a84182711df5fe0f3dc275 WatchSource:0}: Error finding container f5e33d2bab70dd942673d1817d8258527a00b92d47a84182711df5fe0f3dc275: Status 404 returned error can't find the container with id f5e33d2bab70dd942673d1817d8258527a00b92d47a84182711df5fe0f3dc275 Jun 11 23:32:28.976802 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.976773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:28.977187 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.976877 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:28.977187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.976926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:28.977187 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:28.977044 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:28.984259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.984210 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:27:27 +0000 UTC" deadline="2028-03-13 04:02:01.74902007 +0000 UTC" Jun 11 23:32:28.984259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.984253 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15364h29m32.764770619s" Jun 11 23:32:28.984920 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.984886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" event={"ID":"03e0fcbc-ac2c-439d-933c-a5b3a316c789","Type":"ContainerStarted","Data":"94677359984b68f2596d96ac6a51029653aaa3b679fe3b8e772079a8443eac4b"} Jun 11 23:32:28.985937 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.985915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" event={"ID":"8b226d41-e48f-406b-ba8a-253c32d9520c","Type":"ContainerStarted","Data":"4ec145022a5044deba9a52ec2282bddb2efb76a451f76facedbfcdaaf3be8310"} Jun 11 23:32:28.988806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.988778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" event={"ID":"f356dd6ea2b82bf8308e8edc1842431d","Type":"ContainerStarted","Data":"02a24db31c290855202d8ff5d252c229feb3f2268ce2993754ee37e3a9a535f5"} Jun 11 23:32:28.991507 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.991481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhl2k" event={"ID":"59713dcc-1c3b-44c0-ad1f-037e1b9a1679","Type":"ContainerStarted","Data":"f5e33d2bab70dd942673d1817d8258527a00b92d47a84182711df5fe0f3dc275"} Jun 11 23:32:28.993514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.993487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dzwvt" event={"ID":"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c","Type":"ContainerStarted","Data":"69321952062eb0d78ad86019739cbb74214727dc5b3158425e763f8474146029"} Jun 11 23:32:28.996541 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.996517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerStarted","Data":"39807e085db2f25f7ad8cc7f4351edacd97414c90affa3c8a77077f8379f46a8"} Jun 11 23:32:28.997822 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.997801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28dsp" event={"ID":"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b","Type":"ContainerStarted","Data":"953e4c00509ad39c64e6c0d72b81097b07bfddda7e0e1fab959d719d252e62d6"} Jun 11 23:32:28.998716 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.998691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lc6mf" event={"ID":"4407d7ce-2aa6-42f1-a78b-fd9b53df679f","Type":"ContainerStarted","Data":"e12ef1ee11cc53bacd0336601d9f852bdfb662a44d98fbeaddcc322c61d1a3d3"} Jun 11 23:32:28.999817 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:28.999796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"59e84cd50ae2058902e1a015179064441b81f148d70147f0c800a10d62224d2b"} Jun 11 23:32:29.000762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.000743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzdh5" event={"ID":"4af38d7d-27be-44d5-ab3f-49e844cca6e8","Type":"ContainerStarted","Data":"98ddc9c12c045e565e62a90152074897c99343e8c7d857b511c9b1f81bf140cd"} Jun 11 23:32:29.003207 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.003160 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-57.ec2.internal" podStartSLOduration=2.00314901 podStartE2EDuration="2.00314901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:29.002919714 +0000 UTC m=+3.521086142" watchObservedRunningTime="2026-06-11 23:32:29.00314901 +0000 UTC m=+3.521315438" Jun 11 23:32:29.542396 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.542307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:29.542571 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.542474 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:29.542571 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.542543 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:31.542522421 +0000 UTC m=+6.060688842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:29.643440 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.643396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:29.643632 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.643557 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:29.643632 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.643623 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:31.643606112 +0000 UTC m=+6.161772517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:29.745125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.744435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:29.745125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.744667 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:29.745125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.744692 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:29.745125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.744705 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:29.745125 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.744765 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:31.744747452 +0000 UTC m=+6.262913865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:29.979928 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.979248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:29.979928 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:29.979441 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:29.984664 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.984601 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:27:27 +0000 UTC" deadline="2028-03-24 23:32:54.70052081 +0000 UTC" Jun 11 23:32:29.984664 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:29.984636 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15648h0m24.715889447s" Jun 11 23:32:30.017835 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:30.017798 2581 generic.go:356] "Generic (PLEG): container finished" podID="cf49238986804a8be3077ac528abb023" containerID="448e3647f2b5a8b8aeaecebc70618d498a72126fb2d1c931a7585ac50bf7fe3e" exitCode=0 Jun 11 23:32:30.018425 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:30.018311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" event={"ID":"cf49238986804a8be3077ac528abb023","Type":"ContainerDied","Data":"448e3647f2b5a8b8aeaecebc70618d498a72126fb2d1c931a7585ac50bf7fe3e"} Jun 11 23:32:30.977519 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:30.977182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:30.977519 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:30.977318 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:30.977519 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:30.977395 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:30.977519 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:30.977478 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:31.048833 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.048788 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" event={"ID":"cf49238986804a8be3077ac528abb023","Type":"ContainerStarted","Data":"936737aaca2857045dd8ca7ead6f7a9a0acf0d964227a4eec23463e8653120f9"} Jun 11 23:32:31.065099 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.065037 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-57.ec2.internal" podStartSLOduration=4.06501255 podStartE2EDuration="4.06501255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:31.064396657 +0000 UTC m=+5.582563079" watchObservedRunningTime="2026-06-11 23:32:31.06501255 +0000 UTC m=+5.583178979" Jun 11 23:32:31.563702 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.563083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:31.563702 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.563276 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:31.563702 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.563341 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:35.563322644 +0000 UTC m=+10.081489052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:31.664772 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.664203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:31.664772 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.664367 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:31.664772 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.664434 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:35.664415598 +0000 UTC m=+10.182582027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:31.766249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.765576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:31.766249 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.765787 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:31.766249 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.765808 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:31.766249 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.765821 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:31.766249 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.765880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:35.765861337 +0000 UTC m=+10.284027760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:31.976738 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:31.976523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:31.976738 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:31.976661 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:32.977020 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:32.976261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:32.977020 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:32.976404 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:32.977020 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:32.976845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:32.977020 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:32.976957 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:33.976358 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:33.976304 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:33.976559 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:33.976469 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:34.977410 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:34.977057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:34.977410 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:34.977200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:34.977410 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:34.977259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:34.977410 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:34.977353 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:35.602395 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:35.602350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:35.602611 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.602588 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:35.602692 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.602677 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:43.602654766 +0000 UTC m=+18.120821186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:35.704031 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:35.703416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:35.704031 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.703595 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:35.704031 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.703670 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:43.703648794 +0000 UTC m=+18.221815204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:35.804854 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:35.804809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:35.805075 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.805012 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:35.805075 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.805036 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:35.805075 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.805050 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:35.805271 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.805117 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:43.805098213 +0000 UTC m=+18.323264622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:35.977953 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:35.977654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:35.977953 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:35.977772 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:36.977611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:36.976919 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:36.977611 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:36.977068 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:36.977611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:36.977459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:36.977611 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:36.977563 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:37.976333 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:37.976293 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:37.976708 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:37.976439 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:38.977155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:38.977114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:38.977611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:38.977122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:38.977611 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:38.977253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:38.977611 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:38.977376 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:39.976978 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:39.976943 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:39.977285 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:39.977114 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:40.976549 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:40.976505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:40.976748 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:40.976509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:40.976748 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:40.976639 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:40.976838 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:40.976762 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:41.976571 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:41.976529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:41.977069 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:41.976682 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:42.977105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:42.977070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:42.977524 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:42.977073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:42.977524 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:42.977205 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:42.977524 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:42.977294 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:43.668241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:43.668188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:43.668409 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.668368 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:43.668494 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.668454 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:32:59.668431499 +0000 UTC m=+34.186597907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:43.768927 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:43.768892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:43.769129 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.769067 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:43.769209 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.769140 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:32:59.76912 +0000 UTC m=+34.287286408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:43.869667 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:43.869614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:43.869886 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.869797 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:43.869886 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.869827 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:43.869886 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.869840 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:43.869989 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.869895 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:32:59.869881155 +0000 UTC m=+34.388047561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:43.977250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:43.977152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:43.977708 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:43.977303 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:44.976496 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:44.976450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:44.976496 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:44.976477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:44.976726 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:44.976580 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:44.976791 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:44.976733 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:45.977643 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:45.977603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:45.978113 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:45.977715 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:46.977010 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:46.976951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:46.977214 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:46.976951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:46.977214 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:46.977126 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:46.977214 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:46.977168 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:47.977147 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:47.977115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:47.978093 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:47.977232 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:48.087779 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.087734 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhl2k" event={"ID":"59713dcc-1c3b-44c0-ad1f-037e1b9a1679","Type":"ContainerStarted","Data":"5b7b95bc90545fc0cfd84afc2f0946d9010bdf748fd3dda3ac4fdd44e4ff2c1b"} Jun 11 23:32:48.089380 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.089352 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="232a5cbb3d77305350f71c2dd2c49ab7af182235a9b5013c07b5e23a0d542874" exitCode=0 Jun 11 23:32:48.089516 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.089390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"232a5cbb3d77305350f71c2dd2c49ab7af182235a9b5013c07b5e23a0d542874"} Jun 11 23:32:48.091124 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.091092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28dsp" event={"ID":"3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b","Type":"ContainerStarted","Data":"7ff1ed89eebe241fd0c17700a1342a45c0b482ca1ad27cc5d89fb579e2fe8919"} Jun 11 23:32:48.095893 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.095848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lc6mf" event={"ID":"4407d7ce-2aa6-42f1-a78b-fd9b53df679f","Type":"ContainerStarted","Data":"e26e130bdf2104af5493b08712ca929f49cb7a4ad3f21b9f611d2e8f922ef9f6"} Jun 11 23:32:48.097929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.097910 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:32:48.098297 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.098276 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f795df2-f0c8-475f-bf8a-6077d310a6d6" containerID="674d3b20c86765b051970c683599c7fda650d0d5e316d99a029990253e8ca635" exitCode=1 Jun 11 23:32:48.098433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.098353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"43e551d69a5f7f1a77354a2707f07b95d3d5990ea6b8d22b69cdbec7e440d2e7"} Jun 11 23:32:48.098524 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.098470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerDied","Data":"674d3b20c86765b051970c683599c7fda650d0d5e316d99a029990253e8ca635"} Jun 11 23:32:48.098598 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.098531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"20a86097ed05ef70ac8dd4e737359b237f744b5a08c7c8b5351a94fa671727f9"} Jun 11 23:32:48.101061 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.101028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzdh5" event={"ID":"4af38d7d-27be-44d5-ab3f-49e844cca6e8","Type":"ContainerStarted","Data":"43d83cad40e2fc94344975bfa5b9430194033f1797ff1986acd56aa14ed784a1"} Jun 11 23:32:48.102618 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.102594 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" event={"ID":"03e0fcbc-ac2c-439d-933c-a5b3a316c789","Type":"ContainerStarted","Data":"0d3224d2dd34102778796ce08c818a0f4a91cc793eacf7b60e0cc27ec48a3c74"} Jun 11 23:32:48.104281 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.104078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" event={"ID":"8b226d41-e48f-406b-ba8a-253c32d9520c","Type":"ContainerStarted","Data":"d93acf88526f2f683c899f897741abacfae46d629b2528c9519a0b1b95585f37"} Jun 11 23:32:48.108730 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.108355 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dhl2k" podStartSLOduration=3.333726602 podStartE2EDuration="22.108337802s" totalImagesPullingTime="18.7746112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:48.108187677 +0000 UTC m=+22.626354107" watchObservedRunningTime="2026-06-11 23:32:48.108337802 +0000 UTC m=+22.626504231" Jun 11 23:32:48.148844 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.148719 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzdh5" podStartSLOduration=8.210505927 podStartE2EDuration="22.148698298s" totalImagesPullingTime="13.938192371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:48.14860808 +0000 UTC m=+22.666774507" watchObservedRunningTime="2026-06-11 23:32:48.148698298 +0000 UTC m=+22.666864727" Jun 11 23:32:48.170626 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.170568 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lc6mf" podStartSLOduration=3.427340595 podStartE2EDuration="22.170552512s" totalImagesPullingTime="18.743211917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:48.170439786 +0000 UTC m=+22.688606215" watchObservedRunningTime="2026-06-11 23:32:48.170552512 +0000 UTC m=+22.688718941" Jun 11 23:32:48.193571 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.193517 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fc7fx" podStartSLOduration=3.431849125 podStartE2EDuration="22.193498534s" totalImagesPullingTime="18.761649409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:48.192943581 +0000 UTC m=+22.711110010" watchObservedRunningTime="2026-06-11 23:32:48.193498534 +0000 UTC m=+22.711664961" Jun 11 23:32:48.208450 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.208402 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-28dsp" podStartSLOduration=3.500259919 podStartE2EDuration="22.208379071s" totalImagesPullingTime="18.708119152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:48.208051618 +0000 UTC m=+22.726218046" watchObservedRunningTime="2026-06-11 23:32:48.208379071 +0000 UTC m=+22.726545502" Jun 11 23:32:48.976206 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.976118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:48.976206 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:48.976154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:48.976391 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:48.976253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:48.976391 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:48.976371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:49.109712 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.109678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:32:49.110240 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.110210 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"0cc5f3f594f0345d6b67d0ca23a048dbeecf39724685f1e94d11e95754ca6a78"} Jun 11 23:32:49.110331 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.110301 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"88c1f8c12d384a4a2db67c22e21b850fbdc8218e52e8f8d6e492fc91d3f61f4f"} Jun 11 23:32:49.110385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.110357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"caa37166a3b66d80eb43ea33d605cf723f7c3e6bd66d1fee55aa09747093b1f1"} Jun 11 23:32:49.485455 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.485296 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 23:32:49.976780 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.976743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:49.976975 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:49.976893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:49.988849 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.988721 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:32:49.485448095Z","UUID":"3e232995-e27a-40dc-b3ab-81ffbcd54d01","Handler":null,"Name":"","Endpoint":""} Jun 11 23:32:49.990719 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.990677 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 23:32:49.990719 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:49.990720 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 23:32:50.114841 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.114804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" event={"ID":"03e0fcbc-ac2c-439d-933c-a5b3a316c789","Type":"ContainerStarted","Data":"c1197b8c27a2cbb344fc2f2c9f05105f3d2ce8384ef2fc1a564005aeb328b918"} Jun 11 23:32:50.116358 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.116328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dzwvt" event={"ID":"d5c843f9-c6f0-49ac-8e2d-73d6b695e26c","Type":"ContainerStarted","Data":"98558a73a5aa81d74669b4f3382c2017cfafced03305d3d4d61b38bd3302247d"} Jun 11 23:32:50.132918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.132866 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dzwvt" podStartSLOduration=5.384669378 podStartE2EDuration="24.132850971s" totalImagesPullingTime="18.748181593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:50.132768953 +0000 UTC m=+24.650935385" watchObservedRunningTime="2026-06-11 23:32:50.132850971 +0000 UTC m=+24.651017398" Jun 11 23:32:50.474869 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.474838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:50.475952 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.475924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:50.976740 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.976703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:50.976902 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:50.976703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:50.976902 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:50.976822 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:50.976902 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:50.976875 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:51.120883 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.120848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" event={"ID":"03e0fcbc-ac2c-439d-933c-a5b3a316c789","Type":"ContainerStarted","Data":"591e15afe2233a70350984c2e35ed3a8e9bbcd796783df26e1debe9790373dbe"} Jun 11 23:32:51.124266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.124243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:32:51.124710 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.124685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"38c1546581ebed8986400ae50815c4302a25137e7e58a7ec4128494e0cd9489b"} Jun 11 23:32:51.125141 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.124960 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:51.125575 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.125557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzdh5" Jun 11 23:32:51.138471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.138413 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzrw5" podStartSLOduration=3.942260018 podStartE2EDuration="25.138392029s" totalImagesPullingTime="21.196132011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:51.137521082 +0000 UTC m=+25.655687509" watchObservedRunningTime="2026-06-11 23:32:51.138392029 +0000 UTC m=+25.656558460" Jun 11 23:32:51.977150 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:51.977111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:51.977341 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:51.977246 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:52.976514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:52.976330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:52.977134 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:52.976330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:52.977134 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:52.976628 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:52.977134 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:52.976653 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:53.131908 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.131817 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="950b5445f4625754bfe8d05257de257f2d79ed5cb240abbdf1f97abf4055ad86" exitCode=0 Jun 11 23:32:53.132154 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.131903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"950b5445f4625754bfe8d05257de257f2d79ed5cb240abbdf1f97abf4055ad86"} Jun 11 23:32:53.135759 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.135734 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:32:53.136199 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.136172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"1eee6786609b6bd8cab692a5915540dca84199a222b7c060a81eade88df861f3"} Jun 11 23:32:53.136454 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.136423 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:53.136555 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.136499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:53.136609 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.136583 2581 scope.go:117] "RemoveContainer" containerID="674d3b20c86765b051970c683599c7fda650d0d5e316d99a029990253e8ca635" Jun 11 23:32:53.154316 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.154295 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:53.977175 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:53.977128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:53.977606 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:53.977254 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:54.142967 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.142933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:32:54.143401 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.143373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" event={"ID":"0f795df2-f0c8-475f-bf8a-6077d310a6d6","Type":"ContainerStarted","Data":"94a3993410bc5f64f9e62a16661de006ee197596671f7aace44cbf1f4cc94ce6"} Jun 11 23:32:54.143637 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.143618 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:54.160088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.160064 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:32:54.170544 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.170490 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" podStartSLOduration=9.357692035 podStartE2EDuration="28.170475286s" totalImagesPullingTime="18.812783251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:32:54.169121908 +0000 UTC m=+28.687288336" watchObservedRunningTime="2026-06-11 23:32:54.170475286 +0000 UTC m=+28.688641716" Jun 11 23:32:54.611777 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.611489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qhmzc"] Jun 11 23:32:54.611989 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.611898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:54.612066 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:54.612041 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:54.615010 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.614961 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8dxmb"] Jun 11 23:32:54.615183 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.615126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:54.615277 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:54.615253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:54.615683 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.615660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wz62w"] Jun 11 23:32:54.615819 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:54.615799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:54.615952 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:54.615906 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:55.148327 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:55.148287 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="34f05bcceb4ee9736ac61d44c16d3cd2159daf264b32868edf028adf73cd329e" exitCode=0 Jun 11 23:32:55.148949 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:55.148374 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"34f05bcceb4ee9736ac61d44c16d3cd2159daf264b32868edf028adf73cd329e"} Jun 11 23:32:55.977476 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:55.977436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:55.977639 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:55.977543 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:55.977639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:55.977596 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:55.977725 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:55.977691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:56.976249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:56.976211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:56.976807 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:56.976329 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:57.156148 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:57.156109 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="4856a250d179937b4c6d421b2c48a6db1a0a944609b57854ddcb6847d0ecf885" exitCode=0 Jun 11 23:32:57.156351 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:57.156185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"4856a250d179937b4c6d421b2c48a6db1a0a944609b57854ddcb6847d0ecf885"} Jun 11 23:32:57.976902 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:57.976870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:57.977482 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:57.976870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:57.977482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:57.977012 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:32:57.977482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:57.977123 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:58.976449 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:58.976410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:58.976674 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:58.976544 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8dxmb" podUID="a989c7a8-9435-4d21-ae43-65ddc247ea13" Jun 11 23:32:59.681666 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:59.681625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:32:59.682251 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.681812 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:59.682251 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.681897 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret podName:a989c7a8-9435-4d21-ae43-65ddc247ea13 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:31.681877106 +0000 UTC m=+66.200043514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret") pod "global-pull-secret-syncer-8dxmb" (UID: "a989c7a8-9435-4d21-ae43-65ddc247ea13") : object "kube-system"/"original-pull-secret" not registered Jun 11 23:32:59.782935 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:59.782895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:59.783144 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.783061 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:59.783144 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.783130 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:33:31.783110368 +0000 UTC m=+66.301276777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 23:32:59.883709 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:59.883667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:59.883885 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.883801 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 23:32:59.883885 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.883815 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 23:32:59.883885 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.883825 2581 projected.go:196] Error preparing data for projected volume kube-api-access-9ftcj for pod openshift-network-diagnostics/network-check-target-qhmzc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:59.883885 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.883875 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj podName:b7fc0f84-23a5-48a1-8ab7-6289fb811fcb nodeName:}" failed. No retries permitted until 2026-06-11 23:33:31.883861122 +0000 UTC m=+66.402027527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ftcj" (UniqueName: "kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj") pod "network-check-target-qhmzc" (UID: "b7fc0f84-23a5-48a1-8ab7-6289fb811fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 23:32:59.976461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:59.976165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:32:59.976461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:32:59.976182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:32:59.976684 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.976507 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:32:59.976684 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:32:59.976573 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qhmzc" podUID="b7fc0f84-23a5-48a1-8ab7-6289fb811fcb" Jun 11 23:33:00.819874 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.819844 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-57.ec2.internal" event="NodeReady" Jun 11 23:33:00.820312 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.820050 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 23:33:00.866298 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.866255 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sxggh"] Jun 11 23:33:00.894110 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.894072 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r64d4"] Jun 11 23:33:00.894311 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.894205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:00.896714 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.896682 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 23:33:00.896955 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.896937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlkn\"" Jun 11 23:33:00.897211 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.897151 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 23:33:00.916204 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.916173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxggh"] Jun 11 23:33:00.916353 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.916227 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r64d4"] Jun 11 23:33:00.916353 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.916263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:00.918632 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.918605 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 23:33:00.918632 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.918621 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 23:33:00.918829 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.918811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pzwgk\"" Jun 11 23:33:00.919019 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.918982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 23:33:00.976844 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.976808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:33:00.982409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.979822 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:33:00.992270 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:00.992443 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-tmp-dir\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:00.992443 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7tj\" (UniqueName: \"kubernetes.io/projected/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-kube-api-access-8l7tj\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:00.992552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-cert\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:00.992552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sc4v\" (UniqueName: \"kubernetes.io/projected/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-kube-api-access-4sc4v\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:00.992552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:00.992533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-config-volume\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.093910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.093820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.093910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.093881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-tmp-dir\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.093910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.093908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7tj\" (UniqueName: \"kubernetes.io/projected/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-kube-api-access-8l7tj\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.094236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.093976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-cert\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:01.094236 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:01.093988 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:01.094236 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:01.094086 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:01.594062634 +0000 UTC m=+36.112229039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:01.094236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.094201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sc4v\" (UniqueName: \"kubernetes.io/projected/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-kube-api-access-4sc4v\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:01.094433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.094250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-config-volume\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.094433 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.094307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-tmp-dir\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.094865 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.094838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-config-volume\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.098665 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.098641 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-cert\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:01.103572 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.103543 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7tj\" (UniqueName: \"kubernetes.io/projected/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-kube-api-access-8l7tj\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.104221 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.104202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sc4v\" (UniqueName: \"kubernetes.io/projected/52450da7-4a50-4ff6-b45d-6dce16bbfbaa-kube-api-access-4sc4v\") pod \"ingress-canary-r64d4\" (UID: \"52450da7-4a50-4ff6-b45d-6dce16bbfbaa\") " pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:01.227629 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.227587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r64d4" Jun 11 23:33:01.599366 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.599333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:01.599518 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:01.599444 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:01.599518 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:01.599499 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:02.599484292 +0000 UTC m=+37.117650698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:01.628899 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.628866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r64d4"] Jun 11 23:33:01.681170 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:33:01.681139 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52450da7_4a50_4ff6_b45d_6dce16bbfbaa.slice/crio-e25b12908351bfe6a705528beeb6dd690360b57c80166f22150d41284afa6fc7 WatchSource:0}: Error finding container e25b12908351bfe6a705528beeb6dd690360b57c80166f22150d41284afa6fc7: Status 404 returned error can't find the container with id e25b12908351bfe6a705528beeb6dd690360b57c80166f22150d41284afa6fc7 Jun 11 23:33:01.979923 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.979852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:33:01.980318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.980018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:33:01.983335 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.983313 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:33:01.983461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.983376 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mx7t4\"" Jun 11 23:33:01.983461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.983435 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:33:01.983461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.983453 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x5wbg\"" Jun 11 23:33:01.983608 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:01.983461 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:33:02.174317 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:02.174278 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="ac34fe71b88d23cc343da90dabba9d6047c2b760996189772f16aebbd3eadde0" exitCode=0 Jun 11 23:33:02.174505 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:02.174366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"ac34fe71b88d23cc343da90dabba9d6047c2b760996189772f16aebbd3eadde0"} Jun 11 23:33:02.175665 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:02.175639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r64d4" event={"ID":"52450da7-4a50-4ff6-b45d-6dce16bbfbaa","Type":"ContainerStarted","Data":"e25b12908351bfe6a705528beeb6dd690360b57c80166f22150d41284afa6fc7"} Jun 11 23:33:02.607063 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:02.606777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:02.607230 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:02.606939 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:02.607230 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:02.607145 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:04.607124971 +0000 UTC m=+39.125291379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:03.182834 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:03.182768 2581 generic.go:356] "Generic (PLEG): container finished" podID="65bdc258-8964-4843-be10-4215f970ae4f" containerID="0878f422d9e18792b3ce089fca028d858d09696bb650dd0c23a09bdedb9e1097" exitCode=0 Jun 11 23:33:03.182834 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:03.182813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerDied","Data":"0878f422d9e18792b3ce089fca028d858d09696bb650dd0c23a09bdedb9e1097"} Jun 11 23:33:04.188559 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:04.188523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlr25" event={"ID":"65bdc258-8964-4843-be10-4215f970ae4f","Type":"ContainerStarted","Data":"2cb01dc01297d527cc2ebcb87c3463ecb164f2680bafeeab7e0b0aef43a28b18"} Jun 11 23:33:04.189923 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:04.189900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r64d4" event={"ID":"52450da7-4a50-4ff6-b45d-6dce16bbfbaa","Type":"ContainerStarted","Data":"b77a41efc2453fdf2f5dfd198bc21367bb06f41866d425bad2be040b536e38f9"} Jun 11 23:33:04.210102 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:04.210051 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hlr25" podStartSLOduration=8.015854763 podStartE2EDuration="38.210034947s" totalImagesPullingTime="30.194180184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:04.208650943 +0000 UTC m=+38.726817372" watchObservedRunningTime="2026-06-11 23:33:04.210034947 +0000 UTC m=+38.728201375" Jun 11 23:33:04.222378 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:04.222323 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r64d4" podStartSLOduration=2.574580858 podStartE2EDuration="4.222305738s" totalImagesPullingTime="1.64772488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:04.222064468 +0000 UTC m=+38.740230895" watchObservedRunningTime="2026-06-11 23:33:04.222305738 +0000 UTC m=+38.740472166" Jun 11 23:33:04.622646 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:04.622538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:04.622804 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:04.622694 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:04.622804 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:04.622769 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:08.622750262 +0000 UTC m=+43.140916682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:08.652348 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:08.652300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:08.652814 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:08.652455 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:08.652814 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:08.652517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:16.652500313 +0000 UTC m=+51.170666722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:16.711855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:16.711809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:16.712577 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:16.711958 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:16.712577 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:16.712099 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:33:32.71207863 +0000 UTC m=+67.230245054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:26.161187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:26.161160 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcddd" Jun 11 23:33:31.723522 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.723477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:33:31.726169 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.726148 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 23:33:31.737511 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.737474 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a989c7a8-9435-4d21-ae43-65ddc247ea13-original-pull-secret\") pod \"global-pull-secret-syncer-8dxmb\" (UID: \"a989c7a8-9435-4d21-ae43-65ddc247ea13\") " pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:33:31.824524 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.824483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:33:31.827081 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.827060 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 23:33:31.835077 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:31.835051 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:33:31.835146 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:31.835129 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:34:35.835108487 +0000 UTC m=+130.353274894 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : secret "metrics-daemon-secret" not found Jun 11 23:33:31.891199 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.891154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8dxmb" Jun 11 23:33:31.925665 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.925622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:33:31.928563 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.928541 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 23:33:31.938276 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.938249 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 23:33:31.949804 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:31.949765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ftcj\" (UniqueName: \"kubernetes.io/projected/b7fc0f84-23a5-48a1-8ab7-6289fb811fcb-kube-api-access-9ftcj\") pod \"network-check-target-qhmzc\" (UID: \"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb\") " pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:33:32.003766 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.003688 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x5wbg\"" Jun 11 23:33:32.012685 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.012653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:33:32.020369 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.020335 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8dxmb"] Jun 11 23:33:32.023497 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:33:32.023466 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda989c7a8_9435_4d21_ae43_65ddc247ea13.slice/crio-f146dacfeb3548ceb8429dbebe4059db6d46b001d25bb9dda3f9a18b0a3309f9 WatchSource:0}: Error finding container f146dacfeb3548ceb8429dbebe4059db6d46b001d25bb9dda3f9a18b0a3309f9: Status 404 returned error can't find the container with id f146dacfeb3548ceb8429dbebe4059db6d46b001d25bb9dda3f9a18b0a3309f9 Jun 11 23:33:32.140284 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.140246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qhmzc"] Jun 11 23:33:32.144073 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:33:32.144044 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fc0f84_23a5_48a1_8ab7_6289fb811fcb.slice/crio-023b2026ea8f266def4b27822555cf18acf7dac9e8bc3a185830eb6f94d19c39 WatchSource:0}: Error finding container 023b2026ea8f266def4b27822555cf18acf7dac9e8bc3a185830eb6f94d19c39: Status 404 returned error can't find the container with id 023b2026ea8f266def4b27822555cf18acf7dac9e8bc3a185830eb6f94d19c39 Jun 11 23:33:32.257369 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.257280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qhmzc" event={"ID":"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb","Type":"ContainerStarted","Data":"023b2026ea8f266def4b27822555cf18acf7dac9e8bc3a185830eb6f94d19c39"} Jun 11 23:33:32.258219 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.258180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8dxmb" event={"ID":"a989c7a8-9435-4d21-ae43-65ddc247ea13","Type":"ContainerStarted","Data":"f146dacfeb3548ceb8429dbebe4059db6d46b001d25bb9dda3f9a18b0a3309f9"} Jun 11 23:33:32.730456 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:32.730413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:33:32.730929 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:32.730589 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:33:32.730929 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:33:32.730664 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:34:04.730641742 +0000 UTC m=+99.248808154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:33:37.275466 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:37.275424 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qhmzc" event={"ID":"b7fc0f84-23a5-48a1-8ab7-6289fb811fcb","Type":"ContainerStarted","Data":"5c20b76da060fc3e33432fe2c5c879703dbf3b5c4ae73940108adf47b5cbf4e0"} Jun 11 23:33:37.275883 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:37.275537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:33:37.276857 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:37.276834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8dxmb" event={"ID":"a989c7a8-9435-4d21-ae43-65ddc247ea13","Type":"ContainerStarted","Data":"f90390421f71ab120134b010565e9fa4e033d13ef4c120d93fea4ca2e8bdf4a1"} Jun 11 23:33:37.290251 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:37.290195 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qhmzc" podStartSLOduration=66.933326611 podStartE2EDuration="1m11.290176462s" totalImagesPullingTime="4.356849851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:37.289555177 +0000 UTC m=+71.807721607" watchObservedRunningTime="2026-06-11 23:33:37.290176462 +0000 UTC m=+71.808342890" Jun 11 23:33:37.302145 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:33:37.301980 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8dxmb" podStartSLOduration=66.819124813 podStartE2EDuration="1m11.301959124s" totalImagesPullingTime="4.482834311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:33:37.301644976 +0000 UTC m=+71.819811405" watchObservedRunningTime="2026-06-11 23:33:37.301959124 +0000 UTC m=+71.820125552" Jun 11 23:34:04.775632 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:34:04.775589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:34:04.776160 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:34:04.775733 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:34:04.776160 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:34:04.775797 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:08.775781591 +0000 UTC m=+163.293947998 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:34:08.282288 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:34:08.282248 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qhmzc" Jun 11 23:34:35.882080 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:34:35.882040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:34:35.882560 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:34:35.882161 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 23:34:35.882560 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:34:35.882223 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs podName:34d0819d-d6a5-4fb6-ad42-bcfafd7928da nodeName:}" failed. No retries permitted until 2026-06-11 23:36:37.882207746 +0000 UTC m=+252.400374156 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs") pod "network-metrics-daemon-wz62w" (UID: "34d0819d-d6a5-4fb6-ad42-bcfafd7928da") : secret "metrics-daemon-secret" not found Jun 11 23:35:03.906585 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:03.906529 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sxggh" podUID="733fcfd5-13a6-4d08-9d1c-f9c37004bb83" Jun 11 23:35:04.484243 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:04.484167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxggh" Jun 11 23:35:04.995289 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:04.995251 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wz62w" podUID="34d0819d-d6a5-4fb6-ad42-bcfafd7928da" Jun 11 23:35:08.807736 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:08.807630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:35:08.808226 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:08.807771 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 23:35:08.808226 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:08.807829 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls podName:733fcfd5-13a6-4d08-9d1c-f9c37004bb83 nodeName:}" failed. No retries permitted until 2026-06-11 23:37:10.807811734 +0000 UTC m=+285.325978158 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls") pod "dns-default-sxggh" (UID: "733fcfd5-13a6-4d08-9d1c-f9c37004bb83") : secret "dns-default-metrics-tls" not found Jun 11 23:35:15.977856 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:15.977814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:35:38.981743 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.981709 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-c6vf8"] Jun 11 23:35:38.984561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.984539 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-278fh"] Jun 11 23:35:38.984700 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.984658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.988934 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.988240 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh"] Jun 11 23:35:38.989086 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.988283 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:38.990592 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.990566 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 23:35:38.990718 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.990649 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 23:35:38.990852 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.990835 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fzdtp\"" Jun 11 23:35:38.992057 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992037 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg"] Jun 11 23:35:38.992183 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992147 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" Jun 11 23:35:38.992804 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 23:35:38.992898 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992807 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 23:35:38.992898 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992831 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 23:35:38.992898 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992875 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 23:35:38.993212 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.992925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lgr8m\"" Jun 11 23:35:38.994708 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.994688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:38.995600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.995583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j5lgj\"" Jun 11 23:35:38.996890 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.996871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-tmp\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.996981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.996897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkhf\" (UniqueName: \"kubernetes.io/projected/1907afdf-750a-477e-8c00-65786f27783c-kube-api-access-8lkhf\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.996981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.996917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1907afdf-750a-477e-8c00-65786f27783c-serving-cert\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.996981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.996962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-snapshots\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.996981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.996978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.997216 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.997066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:38.998488 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:38.998470 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 23:35:39.001817 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.001780 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:35:39.001817 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.001810 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 23:35:39.002083 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.001924 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 23:35:39.002184 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.002106 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6wl2s\"" Jun 11 23:35:39.002582 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.002564 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 23:35:39.012650 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.012630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-278fh"] Jun 11 23:35:39.032610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.032584 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg"] Jun 11 23:35:39.037361 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.037339 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh"] Jun 11 23:35:39.087011 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.086959 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-c6vf8"] Jun 11 23:35:39.087643 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.087623 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts"] Jun 11 23:35:39.090638 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.090619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.098119 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-snapshots\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098219 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098219 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hn8\" (UniqueName: \"kubernetes.io/projected/a04229c0-cfec-4a0f-a2fb-0c20825aedf0-kube-api-access-l7hn8\") pod \"network-check-source-6947749cfc-vw9nh\" (UID: \"a04229c0-cfec-4a0f-a2fb-0c20825aedf0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" Jun 11 23:35:39.098219 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.098338 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a38ace0-cef8-4e0a-8f4d-031393d6366c-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.098338 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gcjc\" (UniqueName: \"kubernetes.io/projected/1a38ace0-cef8-4e0a-8f4d-031393d6366c-kube-api-access-7gcjc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.098446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-tmp\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkhf\" (UniqueName: \"kubernetes.io/projected/1907afdf-750a-477e-8c00-65786f27783c-kube-api-access-8lkhf\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098588 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b651bde6-1af0-4378-8a7e-502ac03c1952-nginx-conf\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.098588 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a38ace0-cef8-4e0a-8f4d-031393d6366c-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.098588 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1907afdf-750a-477e-8c00-65786f27783c-serving-cert\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098747 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098642 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-tmp\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098747 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1907afdf-750a-477e-8c00-65786f27783c-snapshots\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.098852 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.098779 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.099145 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.099126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1907afdf-750a-477e-8c00-65786f27783c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.100608 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.100592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1907afdf-750a-477e-8c00-65786f27783c-serving-cert\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.101600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.101578 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 23:35:39.101600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.101591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 23:35:39.118601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.118578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 23:35:39.118703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.118609 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:35:39.118703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.118612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-flxcx\"" Jun 11 23:35:39.121479 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.121460 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6"] Jun 11 23:35:39.124378 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.124361 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-856f48bc96-bvjfl"] Jun 11 23:35:39.124499 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.124482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.127089 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.127070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts"] Jun 11 23:35:39.127169 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.127159 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.127986 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.127957 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"telemetry-config\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" Jun 11 23:35:39.128326 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.128308 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-tls\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" Jun 11 23:35:39.128394 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.128315 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-dockercfg-ftnlr\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ftnlr\"" type="*v1.Secret" Jun 11 23:35:39.128394 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.128315 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 11 23:35:39.128394 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.128309 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 11 23:35:39.130605 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.130591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qlkmp\"" Jun 11 23:35:39.143040 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.143018 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkhf\" (UniqueName: \"kubernetes.io/projected/1907afdf-750a-477e-8c00-65786f27783c-kube-api-access-8lkhf\") pod \"insights-operator-5bbd86d6bd-c6vf8\" (UID: \"1907afdf-750a-477e-8c00-65786f27783c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.148811 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148792 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 23:35:39.148919 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148792 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 23:35:39.148919 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148845 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 23:35:39.148919 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148880 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 23:35:39.148919 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 23:35:39.149198 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.148963 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 23:35:39.168046 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.168021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6"] Jun 11 23:35:39.171276 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.171255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-856f48bc96-bvjfl"] Jun 11 23:35:39.199437 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a38ace0-cef8-4e0a-8f4d-031393d6366c-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.199561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hn8\" (UniqueName: \"kubernetes.io/projected/a04229c0-cfec-4a0f-a2fb-0c20825aedf0-kube-api-access-l7hn8\") pod \"network-check-source-6947749cfc-vw9nh\" (UID: \"a04229c0-cfec-4a0f-a2fb-0c20825aedf0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" Jun 11 23:35:39.199561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.199561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f69708d0-9206-4442-a3d7-d43c91d7eb4a-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.199561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-stats-auth\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.199561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gcjc\" (UniqueName: \"kubernetes.io/projected/1a38ace0-cef8-4e0a-8f4d-031393d6366c-kube-api-access-7gcjc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.199602 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkjrc\" (UniqueName: \"kubernetes.io/projected/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-kube-api-access-zkjrc\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.199661 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:39.699642238 +0000 UTC m=+194.217808655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b651bde6-1af0-4378-8a7e-502ac03c1952-nginx-conf\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-default-certificate\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.199855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnb6q\" (UniqueName: \"kubernetes.io/projected/c425350e-c021-45e0-bd1b-f98842ca9fc1-kube-api-access-lnb6q\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.200342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm7h4\" (UniqueName: \"kubernetes.io/projected/f69708d0-9206-4442-a3d7-d43c91d7eb4a-kube-api-access-bm7h4\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.200342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.199912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a38ace0-cef8-4e0a-8f4d-031393d6366c-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.200342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.200034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.200342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.200080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f69708d0-9206-4442-a3d7-d43c91d7eb4a-config\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.200342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.200148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a38ace0-cef8-4e0a-8f4d-031393d6366c-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.200554 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.200458 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b651bde6-1af0-4378-8a7e-502ac03c1952-nginx-conf\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.202050 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.202033 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a38ace0-cef8-4e0a-8f4d-031393d6366c-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.214639 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.214613 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gcjc\" (UniqueName: \"kubernetes.io/projected/1a38ace0-cef8-4e0a-8f4d-031393d6366c-kube-api-access-7gcjc\") pod \"kube-storage-version-migrator-operator-7c578b78fc-82dwg\" (UID: \"1a38ace0-cef8-4e0a-8f4d-031393d6366c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.215179 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.215162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hn8\" (UniqueName: \"kubernetes.io/projected/a04229c0-cfec-4a0f-a2fb-0c20825aedf0-kube-api-access-l7hn8\") pod \"network-check-source-6947749cfc-vw9nh\" (UID: \"a04229c0-cfec-4a0f-a2fb-0c20825aedf0\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" Jun 11 23:35:39.297194 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.297110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" Jun 11 23:35:39.300793 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f69708d0-9206-4442-a3d7-d43c91d7eb4a-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.300903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-stats-auth\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.300903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.300903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkjrc\" (UniqueName: \"kubernetes.io/projected/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-kube-api-access-zkjrc\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.300903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.300903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-default-certificate\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnb6q\" (UniqueName: \"kubernetes.io/projected/c425350e-c021-45e0-bd1b-f98842ca9fc1-kube-api-access-lnb6q\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.300973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm7h4\" (UniqueName: \"kubernetes.io/projected/f69708d0-9206-4442-a3d7-d43c91d7eb4a-kube-api-access-bm7h4\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.301032 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:39.800990273 +0000 UTC m=+194.319156696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.301041 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.301092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.301100 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:39.801082742 +0000 UTC m=+194.319249169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : secret "router-metrics-certs-default" not found Jun 11 23:35:39.301235 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.301132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f69708d0-9206-4442-a3d7-d43c91d7eb4a-config\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.301989 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.301724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f69708d0-9206-4442-a3d7-d43c91d7eb4a-config\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.303583 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.303562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-stats-auth\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.303680 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.303624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f69708d0-9206-4442-a3d7-d43c91d7eb4a-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.303775 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.303760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-default-certificate\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.308546 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.308531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" Jun 11 23:35:39.311176 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.311148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm7h4\" (UniqueName: \"kubernetes.io/projected/f69708d0-9206-4442-a3d7-d43c91d7eb4a-kube-api-access-bm7h4\") pod \"service-ca-operator-7ccbfd59dc-77zts\" (UID: \"f69708d0-9206-4442-a3d7-d43c91d7eb4a\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.313675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.313657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" Jun 11 23:35:39.314576 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.314555 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnb6q\" (UniqueName: \"kubernetes.io/projected/c425350e-c021-45e0-bd1b-f98842ca9fc1-kube-api-access-lnb6q\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.398902 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.398868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" Jun 11 23:35:39.444327 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.444285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-c6vf8"] Jun 11 23:35:39.448392 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:35:39.448359 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1907afdf_750a_477e_8c00_65786f27783c.slice/crio-0f4c81e0cb26e2658dd2802e2dde137ba3f2f71ba5649cc8cf7a918ed0505179 WatchSource:0}: Error finding container 0f4c81e0cb26e2658dd2802e2dde137ba3f2f71ba5649cc8cf7a918ed0505179: Status 404 returned error can't find the container with id 0f4c81e0cb26e2658dd2802e2dde137ba3f2f71ba5649cc8cf7a918ed0505179 Jun 11 23:35:39.531960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.531932 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts"] Jun 11 23:35:39.534966 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:35:39.534942 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69708d0_9206_4442_a3d7_d43c91d7eb4a.slice/crio-b483a891369b5bcb27ed3bb062f631f35ee47a860ea59764a0ef30bfcd6175c4 WatchSource:0}: Error finding container b483a891369b5bcb27ed3bb062f631f35ee47a860ea59764a0ef30bfcd6175c4: Status 404 returned error can't find the container with id b483a891369b5bcb27ed3bb062f631f35ee47a860ea59764a0ef30bfcd6175c4 Jun 11 23:35:39.566110 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.566043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" event={"ID":"f69708d0-9206-4442-a3d7-d43c91d7eb4a","Type":"ContainerStarted","Data":"b483a891369b5bcb27ed3bb062f631f35ee47a860ea59764a0ef30bfcd6175c4"} Jun 11 23:35:39.567036 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.567013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" event={"ID":"1907afdf-750a-477e-8c00-65786f27783c","Type":"ContainerStarted","Data":"0f4c81e0cb26e2658dd2802e2dde137ba3f2f71ba5649cc8cf7a918ed0505179"} Jun 11 23:35:39.665128 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.665095 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh"] Jun 11 23:35:39.666278 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.666250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg"] Jun 11 23:35:39.668628 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:35:39.668604 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04229c0_cfec_4a0f_a2fb_0c20825aedf0.slice/crio-836fcd81fdc95a0ed41826dc435e2a40352b7ba0679d731172589c7218ca1445 WatchSource:0}: Error finding container 836fcd81fdc95a0ed41826dc435e2a40352b7ba0679d731172589c7218ca1445: Status 404 returned error can't find the container with id 836fcd81fdc95a0ed41826dc435e2a40352b7ba0679d731172589c7218ca1445 Jun 11 23:35:39.669181 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:35:39.669168 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a38ace0_cef8_4e0a_8f4d_031393d6366c.slice/crio-6d748b6331bbbc96db9dde8cd2ef00e801148e33847ab87dfb246e7caea2ca7b WatchSource:0}: Error finding container 6d748b6331bbbc96db9dde8cd2ef00e801148e33847ab87dfb246e7caea2ca7b: Status 404 returned error can't find the container with id 6d748b6331bbbc96db9dde8cd2ef00e801148e33847ab87dfb246e7caea2ca7b Jun 11 23:35:39.705869 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.705839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:39.706020 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.705985 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:39.706079 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.706068 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:40.706052286 +0000 UTC m=+195.224218692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:39.806690 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.806654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.806867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:39.806700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:39.806867 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.806817 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:35:39.806867 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.806834 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:40.806821051 +0000 UTC m=+195.324987457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:39.807026 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:39.806879 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:40.806859772 +0000 UTC m=+195.325026179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : secret "router-metrics-certs-default" not found Jun 11 23:35:40.074045 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.074008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 23:35:40.137055 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.137020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 23:35:40.142408 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.142219 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:40.142408 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.142301 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:40.642278573 +0000 UTC m=+195.160444983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:40.143106 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.143083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 23:35:40.151006 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.150958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkjrc\" (UniqueName: \"kubernetes.io/projected/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-kube-api-access-zkjrc\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:40.190868 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.190836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 23:35:40.192552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.192519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:40.325057 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.324786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ftnlr\"" Jun 11 23:35:40.572729 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.572685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" event={"ID":"1a38ace0-cef8-4e0a-8f4d-031393d6366c","Type":"ContainerStarted","Data":"6d748b6331bbbc96db9dde8cd2ef00e801148e33847ab87dfb246e7caea2ca7b"} Jun 11 23:35:40.575186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.575124 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" event={"ID":"a04229c0-cfec-4a0f-a2fb-0c20825aedf0","Type":"ContainerStarted","Data":"f4d26599e0d47228361b6aa841331ae16ecf67181828ab5d09c57cc4f7acdd58"} Jun 11 23:35:40.575186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.575176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" event={"ID":"a04229c0-cfec-4a0f-a2fb-0c20825aedf0","Type":"ContainerStarted","Data":"836fcd81fdc95a0ed41826dc435e2a40352b7ba0679d731172589c7218ca1445"} Jun 11 23:35:40.594048 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.593489 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-vw9nh" podStartSLOduration=2.5934669660000003 podStartE2EDuration="2.593466966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:35:40.592414199 +0000 UTC m=+195.110580629" watchObservedRunningTime="2026-06-11 23:35:40.593466966 +0000 UTC m=+195.111633395" Jun 11 23:35:40.715618 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.715581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:40.715797 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.715675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:40.715797 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.715745 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:40.715797 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.715783 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:40.715962 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.715874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:42.715846865 +0000 UTC m=+197.234013294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:40.715962 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.715899 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:41.715888168 +0000 UTC m=+196.234054580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:40.816799 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.816658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:40.816799 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:40.816801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:40.817066 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.816852 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:42.816831135 +0000 UTC m=+197.334997553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:40.817066 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.816919 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:35:40.817066 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:40.816958 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:42.816946406 +0000 UTC m=+197.335112827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : secret "router-metrics-certs-default" not found Jun 11 23:35:41.725739 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:41.725698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:41.726178 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:41.725872 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:41.726178 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:41.725959 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:43.725937272 +0000 UTC m=+198.244103682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:42.584810 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.584769 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" event={"ID":"f69708d0-9206-4442-a3d7-d43c91d7eb4a","Type":"ContainerStarted","Data":"45679cedc2aab526158844becee7b0c0c25d6695d3f655fe76c4ceec70d0d4c1"} Jun 11 23:35:42.586435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.586412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" event={"ID":"1a38ace0-cef8-4e0a-8f4d-031393d6366c","Type":"ContainerStarted","Data":"e426399f4cb7c0fdceec739b8d516ba8363611dcfd431e0965333a89cccf77ff"} Jun 11 23:35:42.588154 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.588122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" event={"ID":"1907afdf-750a-477e-8c00-65786f27783c","Type":"ContainerStarted","Data":"9e3a8d4f46f2fbbcf5feb7e824b7fc26a129eb4cdd5931f0ca99c03a77e68872"} Jun 11 23:35:42.620016 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.619950 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" podStartSLOduration=0.746777088 podStartE2EDuration="3.619937324s" totalImagesPullingTime="2.873160236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:35:42.602575155 +0000 UTC m=+197.120741584" watchObservedRunningTime="2026-06-11 23:35:42.619937324 +0000 UTC m=+197.138103753" Jun 11 23:35:42.620277 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.620250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" podStartSLOduration=1.8809653210000001 podStartE2EDuration="4.62024072s" totalImagesPullingTime="2.739275399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:35:42.619230183 +0000 UTC m=+197.137396613" watchObservedRunningTime="2026-06-11 23:35:42.62024072 +0000 UTC m=+197.138407148" Jun 11 23:35:42.638362 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.638274 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" podStartSLOduration=1.682257975 podStartE2EDuration="4.638256638s" totalImagesPullingTime="2.955998663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:35:42.636771985 +0000 UTC m=+197.154938413" watchObservedRunningTime="2026-06-11 23:35:42.638256638 +0000 UTC m=+197.156423067" Jun 11 23:35:42.736130 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.736094 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:42.736497 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:42.736253 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:42.736497 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:42.736334 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:46.73631089 +0000 UTC m=+201.254477303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:42.837028 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.836976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:42.837158 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:42.837048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:42.837158 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:42.837139 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:35:42.837248 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:42.837204 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:46.837186334 +0000 UTC m=+201.355352744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:42.837248 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:42.837225 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:46.837214943 +0000 UTC m=+201.355381350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : secret "router-metrics-certs-default" not found Jun 11 23:35:43.746213 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.746174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:43.746565 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.746315 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:43.746565 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.746384 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:47.746364122 +0000 UTC m=+202.264530537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:43.805980 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.805950 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-brq4c"] Jun 11 23:35:43.810351 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.810314 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.812795 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.812771 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 23:35:43.813200 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.813179 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 23:35:43.813325 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.813211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7htj6\"" Jun 11 23:35:43.823268 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.823246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brq4c"] Jun 11 23:35:43.847101 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.847074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e33dfec-1568-47ea-9964-ed03b387a180-crio-socket\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.847224 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.847106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmc5c\" (UniqueName: \"kubernetes.io/projected/5e33dfec-1568-47ea-9964-ed03b387a180-kube-api-access-fmc5c\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.847224 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.847143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.847224 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.847211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e33dfec-1568-47ea-9964-ed03b387a180-data-volume\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.847322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.847238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948535 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmc5c\" (UniqueName: \"kubernetes.io/projected/5e33dfec-1568-47ea-9964-ed03b387a180-kube-api-access-fmc5c\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948688 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948688 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e33dfec-1568-47ea-9964-ed03b387a180-data-volume\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948688 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948824 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.948715 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:43.948824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e33dfec-1568-47ea-9964-ed03b387a180-crio-socket\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.948824 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.948788 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:44.448765245 +0000 UTC m=+198.966931650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : configmap "kube-rbac-proxy" not found Jun 11 23:35:43.948824 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.948815 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:43.949018 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948826 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e33dfec-1568-47ea-9964-ed03b387a180-crio-socket\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.949018 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:43.948872 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:44.448859923 +0000 UTC m=+198.967026329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:43.949018 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.948982 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e33dfec-1568-47ea-9964-ed03b387a180-data-volume\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:43.959026 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:43.959009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmc5c\" (UniqueName: \"kubernetes.io/projected/5e33dfec-1568-47ea-9964-ed03b387a180-kube-api-access-fmc5c\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:44.453972 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:44.453938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:44.454163 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:44.453989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:44.454163 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:44.454078 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:44.454163 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:44.454134 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:44.454163 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:44.454147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:45.454131532 +0000 UTC m=+199.972297937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : configmap "kube-rbac-proxy" not found Jun 11 23:35:44.454307 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:44.454174 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:45.454163087 +0000 UTC m=+199.972329496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:45.463561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:45.463526 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:45.463948 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:45.463579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:45.463948 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:45.463660 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:45.463948 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:45.463677 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:45.463948 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:45.463729 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:47.463715828 +0000 UTC m=+201.981882234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:45.463948 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:45.463744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:47.463736708 +0000 UTC m=+201.981903115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : configmap "kube-rbac-proxy" not found Jun 11 23:35:46.773709 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:46.773668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:46.774112 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:46.773828 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:46.774112 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:46.773898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:54.773881919 +0000 UTC m=+209.292048356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:46.782006 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:46.781969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lc6mf_4407d7ce-2aa6-42f1-a78b-fd9b53df679f/dns-node-resolver/0.log" Jun 11 23:35:46.874475 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:46.874425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:46.874672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:46.874492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:46.874672 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:46.874584 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 23:35:46.874672 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:46.874658 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:54.874641742 +0000 UTC m=+209.392808153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:46.874834 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:46.874679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:54.874672407 +0000 UTC m=+209.392838813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : secret "router-metrics-certs-default" not found Jun 11 23:35:47.379629 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:47.379596 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28dsp_3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b/node-ca/0.log" Jun 11 23:35:47.480305 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:47.480267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:47.480482 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:47.480321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:47.480482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.480386 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:47.480482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.480429 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:47.480482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.480449 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:51.480432467 +0000 UTC m=+205.998598873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : configmap "kube-rbac-proxy" not found Jun 11 23:35:47.480482 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.480468 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:51.480456722 +0000 UTC m=+205.998623127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:47.782964 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:47.782926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:47.783341 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.783087 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:47.783341 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:47.783151 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:55.78313679 +0000 UTC m=+210.301303196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:48.389624 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:48.389590 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r64d4_52450da7-4a50-4ff6-b45d-6dce16bbfbaa/serve-healthcheck-canary/0.log" Jun 11 23:35:49.181937 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:49.181907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-82dwg_1a38ace0-cef8-4e0a-8f4d-031393d6366c/kube-storage-version-migrator-operator/0.log" Jun 11 23:35:51.512081 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:51.512032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:51.512468 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:51.512102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:51.512468 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:51.512163 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 23:35:51.512468 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:51.512212 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 23:35:51.512468 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:51.512228 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:59.512213018 +0000 UTC m=+214.030379423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : configmap "kube-rbac-proxy" not found Jun 11 23:35:51.512468 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:51.512256 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls podName:5e33dfec-1568-47ea-9964-ed03b387a180 nodeName:}" failed. No retries permitted until 2026-06-11 23:35:59.51224342 +0000 UTC m=+214.030409826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brq4c" (UID: "5e33dfec-1568-47ea-9964-ed03b387a180") : secret "insights-runtime-extractor-tls" not found Jun 11 23:35:54.843279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:54.843233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:35:54.843766 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:54.843409 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 23:35:54.843766 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:54.843498 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert podName:b651bde6-1af0-4378-8a7e-502ac03c1952 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:10.843473867 +0000 UTC m=+225.361640273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-278fh" (UID: "b651bde6-1af0-4378-8a7e-502ac03c1952") : secret "networking-console-plugin-cert" not found Jun 11 23:35:54.943763 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:54.943721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:54.943954 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:54.943779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:54.944044 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:54.943956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle podName:c425350e-c021-45e0-bd1b-f98842ca9fc1 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:10.943938331 +0000 UTC m=+225.462104737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle") pod "router-default-856f48bc96-bvjfl" (UID: "c425350e-c021-45e0-bd1b-f98842ca9fc1") : configmap references non-existent config key: service-ca.crt Jun 11 23:35:54.946114 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:54.946086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c425350e-c021-45e0-bd1b-f98842ca9fc1-metrics-certs\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:35:55.850436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:55.850394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:35:55.850856 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:55.850541 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:55.850856 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:35:55.850605 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls podName:5ce6727e-bcbc-490d-a35b-c3f33869c1d9 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:11.850589255 +0000 UTC m=+226.368755660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-grnf6" (UID: "5ce6727e-bcbc-490d-a35b-c3f33869c1d9") : secret "cluster-monitoring-operator-tls" not found Jun 11 23:35:59.582321 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.582278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:59.582712 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.582333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:59.582835 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.582815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e33dfec-1568-47ea-9964-ed03b387a180-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:59.584648 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.584620 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e33dfec-1568-47ea-9964-ed03b387a180-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brq4c\" (UID: \"5e33dfec-1568-47ea-9964-ed03b387a180\") " pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:59.719941 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.719904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brq4c" Jun 11 23:35:59.849159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:35:59.849074 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brq4c"] Jun 11 23:35:59.852374 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:35:59.852345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e33dfec_1568_47ea_9964_ed03b387a180.slice/crio-d7eb985a3e11ead6e791868a219d69e75136737aab83e591e80c7ed3c5fdd482 WatchSource:0}: Error finding container d7eb985a3e11ead6e791868a219d69e75136737aab83e591e80c7ed3c5fdd482: Status 404 returned error can't find the container with id d7eb985a3e11ead6e791868a219d69e75136737aab83e591e80c7ed3c5fdd482 Jun 11 23:36:00.648544 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:00.648442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brq4c" event={"ID":"5e33dfec-1568-47ea-9964-ed03b387a180","Type":"ContainerStarted","Data":"d7eb985a3e11ead6e791868a219d69e75136737aab83e591e80c7ed3c5fdd482"} Jun 11 23:36:03.659948 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:03.659860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brq4c" event={"ID":"5e33dfec-1568-47ea-9964-ed03b387a180","Type":"ContainerStarted","Data":"6a4f7cf514bd99d9ebc7878e66b67602223bf43583b6f4bc569dcb3099cae7ab"} Jun 11 23:36:04.665368 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:04.665329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brq4c" event={"ID":"5e33dfec-1568-47ea-9964-ed03b387a180","Type":"ContainerStarted","Data":"ef6f266b6b51662c6cfe0a5be623304b5c5b657c5e602e37b3c1fd0318159c01"} Jun 11 23:36:05.449279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.449245 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8454c7b78-87s58"] Jun 11 23:36:05.457114 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.457087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.459953 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.459918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 23:36:05.459953 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.459918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 23:36:05.460174 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.459917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7rvk7\"" Jun 11 23:36:05.460174 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.460018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 23:36:05.466626 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.465567 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 23:36:05.466626 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.466354 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8454c7b78-87s58"] Jun 11 23:36:05.538905 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.538868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-installation-pull-secrets\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539102 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.538945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-image-registry-private-configuration\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539102 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-certificates\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539217 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-trusted-ca\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539271 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-bound-sa-token\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539325 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrm5\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-kube-api-access-wbrm5\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539374 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd1399bf-05af-484f-ab2f-35b77b9926c2-ca-trust-extracted\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.539420 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.539398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-tls\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.640686 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-trusted-ca\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.640867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-bound-sa-token\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.640867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrm5\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-kube-api-access-wbrm5\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.640867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd1399bf-05af-484f-ab2f-35b77b9926c2-ca-trust-extracted\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.640867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-tls\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641151 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-installation-pull-secrets\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641151 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-image-registry-private-configuration\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641151 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.640969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-certificates\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641383 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.641354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dd1399bf-05af-484f-ab2f-35b77b9926c2-ca-trust-extracted\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641839 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.641820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-certificates\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.641918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.641888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd1399bf-05af-484f-ab2f-35b77b9926c2-trusted-ca\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.643428 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.643407 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-image-registry-private-configuration\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.644301 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.644278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-registry-tls\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.644396 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.644278 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dd1399bf-05af-484f-ab2f-35b77b9926c2-installation-pull-secrets\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.651299 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.651274 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-bound-sa-token\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.652777 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.652752 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrm5\" (UniqueName: \"kubernetes.io/projected/dd1399bf-05af-484f-ab2f-35b77b9926c2-kube-api-access-wbrm5\") pod \"image-registry-8454c7b78-87s58\" (UID: \"dd1399bf-05af-484f-ab2f-35b77b9926c2\") " pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.768803 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.768767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:05.898058 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:05.898024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8454c7b78-87s58"] Jun 11 23:36:05.900702 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:05.900674 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1399bf_05af_484f_ab2f_35b77b9926c2.slice/crio-54daccd86e8651184818df26fc8b6c059b1176548f558a718b1c88629d14245a WatchSource:0}: Error finding container 54daccd86e8651184818df26fc8b6c059b1176548f558a718b1c88629d14245a: Status 404 returned error can't find the container with id 54daccd86e8651184818df26fc8b6c059b1176548f558a718b1c88629d14245a Jun 11 23:36:06.675125 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.675091 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brq4c" event={"ID":"5e33dfec-1568-47ea-9964-ed03b387a180","Type":"ContainerStarted","Data":"859eed46ac70fd59c8161b028c877a649745830ef432018ba3d02b9e141f5008"} Jun 11 23:36:06.676546 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.676517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8454c7b78-87s58" event={"ID":"dd1399bf-05af-484f-ab2f-35b77b9926c2","Type":"ContainerStarted","Data":"195b6fb0ca55156c3dfe4f953f4e719309cfb0f0cd0260c92e2fb8e749703ee2"} Jun 11 23:36:06.676673 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.676561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8454c7b78-87s58" event={"ID":"dd1399bf-05af-484f-ab2f-35b77b9926c2","Type":"ContainerStarted","Data":"54daccd86e8651184818df26fc8b6c059b1176548f558a718b1c88629d14245a"} Jun 11 23:36:06.676673 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.676584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:06.693063 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.693023 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-brq4c" podStartSLOduration=18.017510343 podStartE2EDuration="23.692985635s" totalImagesPullingTime="5.675475292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:35:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:06.691488747 +0000 UTC m=+221.209655174" watchObservedRunningTime="2026-06-11 23:36:06.692985635 +0000 UTC m=+221.211152063" Jun 11 23:36:06.708510 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:06.708385 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podStartSLOduration=1.708372363 podStartE2EDuration="1.708372363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:06.707988443 +0000 UTC m=+221.226154871" watchObservedRunningTime="2026-06-11 23:36:06.708372363 +0000 UTC m=+221.226538785" Jun 11 23:36:10.880949 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:10.880915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:36:10.883409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:10.883384 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b651bde6-1af0-4378-8a7e-502ac03c1952-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-278fh\" (UID: \"b651bde6-1af0-4378-8a7e-502ac03c1952\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:36:10.981685 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:10.981643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:10.982309 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:10.982289 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c425350e-c021-45e0-bd1b-f98842ca9fc1-service-ca-bundle\") pod \"router-default-856f48bc96-bvjfl\" (UID: \"c425350e-c021-45e0-bd1b-f98842ca9fc1\") " pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:11.103376 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.103328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" Jun 11 23:36:11.225756 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.225724 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-278fh"] Jun 11 23:36:11.228796 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:11.228767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb651bde6_1af0_4378_8a7e_502ac03c1952.slice/crio-34d325c6dfac64dd50c7778a25b9015876e62da0212d885f280b0f3129db1977 WatchSource:0}: Error finding container 34d325c6dfac64dd50c7778a25b9015876e62da0212d885f280b0f3129db1977: Status 404 returned error can't find the container with id 34d325c6dfac64dd50c7778a25b9015876e62da0212d885f280b0f3129db1977 Jun 11 23:36:11.238855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.238833 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:11.367393 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.367363 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-856f48bc96-bvjfl"] Jun 11 23:36:11.370272 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:11.370244 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc425350e_c021_45e0_bd1b_f98842ca9fc1.slice/crio-5b8bb4ae27f87230eff014f6aea9daad1a42179a7923362d8afede4a6df605df WatchSource:0}: Error finding container 5b8bb4ae27f87230eff014f6aea9daad1a42179a7923362d8afede4a6df605df: Status 404 returned error can't find the container with id 5b8bb4ae27f87230eff014f6aea9daad1a42179a7923362d8afede4a6df605df Jun 11 23:36:11.697586 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.697551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-856f48bc96-bvjfl" event={"ID":"c425350e-c021-45e0-bd1b-f98842ca9fc1","Type":"ContainerStarted","Data":"6cf2ac39e24fbf1435b29369e13eb7d05f66670f644fb39dcae531c2a166e76a"} Jun 11 23:36:11.697789 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.697599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-856f48bc96-bvjfl" event={"ID":"c425350e-c021-45e0-bd1b-f98842ca9fc1","Type":"ContainerStarted","Data":"5b8bb4ae27f87230eff014f6aea9daad1a42179a7923362d8afede4a6df605df"} Jun 11 23:36:11.698691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.698669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" event={"ID":"b651bde6-1af0-4378-8a7e-502ac03c1952","Type":"ContainerStarted","Data":"34d325c6dfac64dd50c7778a25b9015876e62da0212d885f280b0f3129db1977"} Jun 11 23:36:11.721304 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.721250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-856f48bc96-bvjfl" podStartSLOduration=32.721232273 podStartE2EDuration="32.721232273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:11.72083414 +0000 UTC m=+226.239000581" watchObservedRunningTime="2026-06-11 23:36:11.721232273 +0000 UTC m=+226.239398754" Jun 11 23:36:11.891117 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.890700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:36:11.893735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:11.893708 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5ce6727e-bcbc-490d-a35b-c3f33869c1d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-grnf6\" (UID: \"5ce6727e-bcbc-490d-a35b-c3f33869c1d9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:36:12.134070 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.133972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" Jun 11 23:36:12.241242 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.240036 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:12.243801 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.243766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:12.390958 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.390934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6"] Jun 11 23:36:12.391769 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:12.391748 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce6727e_bcbc_490d_a35b_c3f33869c1d9.slice/crio-0c8e6e92b40c4e5b8473c1c2f718f6090e4e1ab131977f506b64e83ffe002cc4 WatchSource:0}: Error finding container 0c8e6e92b40c4e5b8473c1c2f718f6090e4e1ab131977f506b64e83ffe002cc4: Status 404 returned error can't find the container with id 0c8e6e92b40c4e5b8473c1c2f718f6090e4e1ab131977f506b64e83ffe002cc4 Jun 11 23:36:12.702371 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.702335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" event={"ID":"5ce6727e-bcbc-490d-a35b-c3f33869c1d9","Type":"ContainerStarted","Data":"0c8e6e92b40c4e5b8473c1c2f718f6090e4e1ab131977f506b64e83ffe002cc4"} Jun 11 23:36:12.703693 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.703660 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" event={"ID":"b651bde6-1af0-4378-8a7e-502ac03c1952","Type":"ContainerStarted","Data":"ffc33056ac622c06034c9665305c23e891121ab932c057ab88ca159ca8e73aa0"} Jun 11 23:36:12.703944 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.703919 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:12.705028 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.705009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-856f48bc96-bvjfl" Jun 11 23:36:12.719818 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:12.719764 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-278fh" podStartSLOduration=33.639300375 podStartE2EDuration="34.719750503s" totalImagesPullingTime="1.080450128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:12.718482425 +0000 UTC m=+227.236648854" watchObservedRunningTime="2026-06-11 23:36:12.719750503 +0000 UTC m=+227.237916962" Jun 11 23:36:14.402128 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.402054 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll"] Jun 11 23:36:14.405058 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.405042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:14.407439 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.407418 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-svl9q\"" Jun 11 23:36:14.407559 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.407423 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 23:36:14.412647 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.412624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll"] Jun 11 23:36:14.513931 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.513890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c4cb332-cca0-4d60-ae3f-bba7916040d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-j75ll\" (UID: \"8c4cb332-cca0-4d60-ae3f-bba7916040d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:14.614319 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.614286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c4cb332-cca0-4d60-ae3f-bba7916040d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-j75ll\" (UID: \"8c4cb332-cca0-4d60-ae3f-bba7916040d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:14.616735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.616715 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c4cb332-cca0-4d60-ae3f-bba7916040d0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-j75ll\" (UID: \"8c4cb332-cca0-4d60-ae3f-bba7916040d0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:14.711897 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.711864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" event={"ID":"5ce6727e-bcbc-490d-a35b-c3f33869c1d9","Type":"ContainerStarted","Data":"e04d5e866cfb0a21d57492902298fbd2ec3a1949a8f76083a5b8b82770c7aeb0"} Jun 11 23:36:14.714379 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.714358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:14.728719 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.728677 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-grnf6" podStartSLOduration=34.182277368 podStartE2EDuration="35.728661487s" totalImagesPullingTime="1.546384119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:14.726676515 +0000 UTC m=+229.244842947" watchObservedRunningTime="2026-06-11 23:36:14.728661487 +0000 UTC m=+229.246827914" Jun 11 23:36:14.855876 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:14.855844 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll"] Jun 11 23:36:14.858725 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:14.858691 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4cb332_cca0_4d60_ae3f_bba7916040d0.slice/crio-9166a956c0b01fdef10d32a7cfd315974285bb60d66126e68cf7da017bc69d05 WatchSource:0}: Error finding container 9166a956c0b01fdef10d32a7cfd315974285bb60d66126e68cf7da017bc69d05: Status 404 returned error can't find the container with id 9166a956c0b01fdef10d32a7cfd315974285bb60d66126e68cf7da017bc69d05 Jun 11 23:36:15.717141 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:15.717100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" event={"ID":"8c4cb332-cca0-4d60-ae3f-bba7916040d0","Type":"ContainerStarted","Data":"9166a956c0b01fdef10d32a7cfd315974285bb60d66126e68cf7da017bc69d05"} Jun 11 23:36:16.721959 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.721920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" event={"ID":"8c4cb332-cca0-4d60-ae3f-bba7916040d0","Type":"ContainerStarted","Data":"79ac616e6bbd87afc4770ba83a35da6fcf954d539b617e23157b5b7e5f4e2435"} Jun 11 23:36:16.722407 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.722192 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:16.727106 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.727081 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" Jun 11 23:36:16.735831 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.735806 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:36:16.750613 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.750568 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-j75ll" podStartSLOduration=1.3596072860000001 podStartE2EDuration="2.750552241s" totalImagesPullingTime="1.390944955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:16.749481416 +0000 UTC m=+231.267647844" watchObservedRunningTime="2026-06-11 23:36:16.750552241 +0000 UTC m=+231.268718668" Jun 11 23:36:16.757925 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.757901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:36:16.758052 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.757984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.760647 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.760626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 23:36:16.760774 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.760699 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 23:36:16.760959 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.760931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 23:36:16.760959 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.760951 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 23:36:16.761143 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.760936 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 23:36:16.761789 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.761768 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 23:36:16.761887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.761815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-slhlc\"" Jun 11 23:36:16.761887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.761874 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 23:36:16.765718 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.765701 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 23:36:16.932081 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932081 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932302 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932302 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6h4x\" (UniqueName: \"kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932302 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932302 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:16.932434 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:16.932321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033460 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033460 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033460 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6h4x\" (UniqueName: \"kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.033741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.033587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.034215 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.034185 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.034323 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.034234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.034443 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.034420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.034479 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.034428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.035933 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.035907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.036083 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.036063 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.040660 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.040643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6h4x\" (UniqueName: \"kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x\") pod \"console-86f8d6bc9f-mg2v5\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.068558 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.068526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:17.220149 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.220116 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:36:17.222828 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:17.222801 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0674b48a_79d0_43bb_989f_fbac2d5392d3.slice/crio-4de043839c8d8b43b5fde8d137ee3ba96cb809389e5576d7017856eff53e93d1 WatchSource:0}: Error finding container 4de043839c8d8b43b5fde8d137ee3ba96cb809389e5576d7017856eff53e93d1: Status 404 returned error can't find the container with id 4de043839c8d8b43b5fde8d137ee3ba96cb809389e5576d7017856eff53e93d1 Jun 11 23:36:17.727667 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:17.727623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8d6bc9f-mg2v5" event={"ID":"0674b48a-79d0-43bb-989f-fbac2d5392d3","Type":"ContainerStarted","Data":"4de043839c8d8b43b5fde8d137ee3ba96cb809389e5576d7017856eff53e93d1"} Jun 11 23:36:20.739687 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:20.739647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8d6bc9f-mg2v5" event={"ID":"0674b48a-79d0-43bb-989f-fbac2d5392d3","Type":"ContainerStarted","Data":"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d"} Jun 11 23:36:20.755841 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:20.755794 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f8d6bc9f-mg2v5" podStartSLOduration=2.250815152 podStartE2EDuration="4.755779079s" totalImagesPullingTime="2.504963927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:20.754542441 +0000 UTC m=+235.272708867" watchObservedRunningTime="2026-06-11 23:36:20.755779079 +0000 UTC m=+235.273945507" Jun 11 23:36:25.773021 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:25.772972 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:25.773476 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:25.773042 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:27.069188 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.069147 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:27.069672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.069217 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:36:27.070562 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.070540 2581 patch_prober.go:28] interesting pod/console-86f8d6bc9f-mg2v5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 23:36:27.070640 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.070602 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 23:36:27.684410 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.684373 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:27.684574 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:27.684429 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:28.818552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.818518 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt"] Jun 11 23:36:28.823068 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.823044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:28.825445 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.825416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 23:36:28.825556 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.825534 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-94x48\"" Jun 11 23:36:28.825650 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.825634 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 23:36:28.826457 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.826435 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 23:36:28.836076 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.836053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6"] Jun 11 23:36:28.839587 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.839565 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt"] Jun 11 23:36:28.839699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.839673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.842102 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.842081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 23:36:28.842211 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.842170 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4jc68\"" Jun 11 23:36:28.842319 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.842293 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 23:36:28.842420 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.842397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 23:36:28.858445 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.858418 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6"] Jun 11 23:36:28.866976 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.866952 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hm9lk"] Jun 11 23:36:28.870209 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.870194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.872895 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.872869 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 23:36:28.873039 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.872875 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v2s2m\"" Jun 11 23:36:28.873039 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.872875 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 23:36:28.873233 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.873214 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 23:36:28.921027 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.920980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:28.921027 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qcnc\" (UniqueName: \"kubernetes.io/projected/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-kube-api-access-7qcnc\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-sys\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-accelerators-collector-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-textfile\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-root\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5f11ffd-5458-4f92-a197-0566df8e1ae1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclqj\" (UniqueName: \"kubernetes.io/projected/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-api-access-nclqj\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2qb\" (UniqueName: \"kubernetes.io/projected/61805558-78b4-4aad-9e6e-ed8b6f743788-kube-api-access-fj2qb\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:28.921447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921744 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-metrics-client-ca\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:28.921744 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:28.921525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-wtmp\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.022399 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-root\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.022399 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.022601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5f11ffd-5458-4f92-a197-0566df8e1ae1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.022601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-root\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.022601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclqj\" (UniqueName: \"kubernetes.io/projected/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-api-access-nclqj\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.022601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.022601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2qb\" (UniqueName: \"kubernetes.io/projected/61805558-78b4-4aad-9e6e-ed8b6f743788-kube-api-access-fj2qb\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.022824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.022824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.022824 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.022789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5f11ffd-5458-4f92-a197-0566df8e1ae1-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.023280 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023280 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.023442 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-metrics-client-ca\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023442 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023326 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 23:36:29.023442 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023330 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f11ffd-5458-4f92-a197-0566df8e1ae1-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.023442 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-wtmp\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023442 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls podName:61805558-78b4-4aad-9e6e-ed8b6f743788 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:29.523357235 +0000 UTC m=+244.041523640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls") pod "node-exporter-hm9lk" (UID: "61805558-78b4-4aad-9e6e-ed8b6f743788") : secret "node-exporter-tls" not found Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023468 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qcnc\" (UniqueName: \"kubernetes.io/projected/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-kube-api-access-7qcnc\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-wtmp\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-sys\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023583 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023629 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls podName:37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:29.523613957 +0000 UTC m=+244.041780363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-72mjt" (UID: "37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15") : secret "openshift-state-metrics-tls" not found Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023648 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61805558-78b4-4aad-9e6e-ed8b6f743788-sys\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.023699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-accelerators-collector-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023786 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-textfile\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.023834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-metrics-client-ca\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024118 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:36:29.023846 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls podName:e5f11ffd-5458-4f92-a197-0566df8e1ae1 nodeName:}" failed. No retries permitted until 2026-06-11 23:36:29.523830196 +0000 UTC m=+244.041996603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-xkhh6" (UID: "e5f11ffd-5458-4f92-a197-0566df8e1ae1") : secret "kube-state-metrics-tls" not found Jun 11 23:36:29.024469 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.024137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-textfile\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024469 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.024141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-accelerators-collector-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.024469 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.024398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.025253 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.025230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.025401 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.025380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.026553 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.026536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.030892 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.030873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qcnc\" (UniqueName: \"kubernetes.io/projected/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-kube-api-access-7qcnc\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.030979 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.030949 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2qb\" (UniqueName: \"kubernetes.io/projected/61805558-78b4-4aad-9e6e-ed8b6f743788-kube-api-access-fj2qb\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.031379 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.031358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclqj\" (UniqueName: \"kubernetes.io/projected/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-api-access-nclqj\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.527750 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.527714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.527925 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.527801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.527925 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.527833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.530207 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.530173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72mjt\" (UID: \"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.530332 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.530217 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/61805558-78b4-4aad-9e6e-ed8b6f743788-node-exporter-tls\") pod \"node-exporter-hm9lk\" (UID: \"61805558-78b4-4aad-9e6e-ed8b6f743788\") " pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.530332 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.530224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f11ffd-5458-4f92-a197-0566df8e1ae1-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-xkhh6\" (UID: \"e5f11ffd-5458-4f92-a197-0566df8e1ae1\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.732459 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.732421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" Jun 11 23:36:29.749181 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.749148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" Jun 11 23:36:29.779602 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.779521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hm9lk" Jun 11 23:36:29.796469 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:29.796375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61805558_78b4_4aad_9e6e_ed8b6f743788.slice/crio-5b80881c7c50bbbd91a7f4df85795091c93e9553d4e289b2404ea79bd26393bf WatchSource:0}: Error finding container 5b80881c7c50bbbd91a7f4df85795091c93e9553d4e289b2404ea79bd26393bf: Status 404 returned error can't find the container with id 5b80881c7c50bbbd91a7f4df85795091c93e9553d4e289b2404ea79bd26393bf Jun 11 23:36:29.890038 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.890005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt"] Jun 11 23:36:29.892936 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:29.892895 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a6de7c_dc42_4f1d_bb8a_f3a33fd4ca15.slice/crio-7afc76edb2ed09ebff2711781cee68fd3441660867a96cc14df9856e84d22e46 WatchSource:0}: Error finding container 7afc76edb2ed09ebff2711781cee68fd3441660867a96cc14df9856e84d22e46: Status 404 returned error can't find the container with id 7afc76edb2ed09ebff2711781cee68fd3441660867a96cc14df9856e84d22e46 Jun 11 23:36:29.910563 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:29.910540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6"] Jun 11 23:36:29.912766 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:29.912730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f11ffd_5458_4f92_a197_0566df8e1ae1.slice/crio-5355adb9a758f8f610e6d56f5f26dde8bec226eda1ff536ec99773f29628459f WatchSource:0}: Error finding container 5355adb9a758f8f610e6d56f5f26dde8bec226eda1ff536ec99773f29628459f: Status 404 returned error can't find the container with id 5355adb9a758f8f610e6d56f5f26dde8bec226eda1ff536ec99773f29628459f Jun 11 23:36:30.781741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:30.781705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" event={"ID":"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15","Type":"ContainerStarted","Data":"e6e0eab0287aab1871956d724afe3477e6c8c361954415a45b8fee04ae997d9b"} Jun 11 23:36:30.781922 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:30.781803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" event={"ID":"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15","Type":"ContainerStarted","Data":"c3cf213f3e16a1835984bbb077ba50638d871b4750fed1292f26e318bfd6dce3"} Jun 11 23:36:30.781922 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:30.781837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" event={"ID":"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15","Type":"ContainerStarted","Data":"7afc76edb2ed09ebff2711781cee68fd3441660867a96cc14df9856e84d22e46"} Jun 11 23:36:30.783114 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:30.783085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hm9lk" event={"ID":"61805558-78b4-4aad-9e6e-ed8b6f743788","Type":"ContainerStarted","Data":"5b80881c7c50bbbd91a7f4df85795091c93e9553d4e289b2404ea79bd26393bf"} Jun 11 23:36:30.784413 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:30.784383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" event={"ID":"e5f11ffd-5458-4f92-a197-0566df8e1ae1","Type":"ContainerStarted","Data":"5355adb9a758f8f610e6d56f5f26dde8bec226eda1ff536ec99773f29628459f"} Jun 11 23:36:31.789718 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.789683 2581 generic.go:356] "Generic (PLEG): container finished" podID="61805558-78b4-4aad-9e6e-ed8b6f743788" containerID="cf6e4af2022a15f1052c12af6db563f9413f7cc5ebb22b88d7d1eed611d83b90" exitCode=0 Jun 11 23:36:31.790164 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.789771 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hm9lk" event={"ID":"61805558-78b4-4aad-9e6e-ed8b6f743788","Type":"ContainerDied","Data":"cf6e4af2022a15f1052c12af6db563f9413f7cc5ebb22b88d7d1eed611d83b90"} Jun 11 23:36:31.792081 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.792053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" event={"ID":"e5f11ffd-5458-4f92-a197-0566df8e1ae1","Type":"ContainerStarted","Data":"71464a950b985d6a24919a2960216416c62feafbd52452ee08b62578e1a20861"} Jun 11 23:36:31.792207 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.792122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" event={"ID":"e5f11ffd-5458-4f92-a197-0566df8e1ae1","Type":"ContainerStarted","Data":"c66b545f1a71f845c5841134501aff43bc2e974819e66c1630a2639360a70a82"} Jun 11 23:36:31.792207 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.792154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" event={"ID":"e5f11ffd-5458-4f92-a197-0566df8e1ae1","Type":"ContainerStarted","Data":"ace003783a1b76209793e0fa9833c6a2f298069005850fcc78d954123f36362a"} Jun 11 23:36:31.794287 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.794264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" event={"ID":"37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15","Type":"ContainerStarted","Data":"2962ca89c6f648f65ec6ce5c8e80a69cb63d0485bcdcbc72c01428d174408ac1"} Jun 11 23:36:31.824206 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.824137 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72mjt" podStartSLOduration=2.382647178 podStartE2EDuration="3.824114975s" totalImagesPullingTime="1.441467797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:31.822023604 +0000 UTC m=+246.340190035" watchObservedRunningTime="2026-06-11 23:36:31.824114975 +0000 UTC m=+246.342281384" Jun 11 23:36:31.841862 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:31.841808 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-xkhh6" podStartSLOduration=2.296545239 podStartE2EDuration="3.84178806s" totalImagesPullingTime="1.545242821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:31.841045223 +0000 UTC m=+246.359211653" watchObservedRunningTime="2026-06-11 23:36:31.84178806 +0000 UTC m=+246.359954488" Jun 11 23:36:32.800584 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:32.800549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hm9lk" event={"ID":"61805558-78b4-4aad-9e6e-ed8b6f743788","Type":"ContainerStarted","Data":"0aea6c8396a5e4bf243b95daa636eac2577f99f380d4e517a6fb5340e976a063"} Jun 11 23:36:32.800971 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:32.800606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hm9lk" event={"ID":"61805558-78b4-4aad-9e6e-ed8b6f743788","Type":"ContainerStarted","Data":"0e37fba13c890dce37e3f3ffb3a96295fee7a7725a235bf53e721f917e223eb0"} Jun 11 23:36:33.781179 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.781122 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hm9lk" podStartSLOduration=4.031131433 podStartE2EDuration="5.781101424s" totalImagesPullingTime="1.659144898s" totalInitContainerRuntime="90.825093ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:32.821183197 +0000 UTC m=+247.339349630" watchObservedRunningTime="2026-06-11 23:36:33.781101424 +0000 UTC m=+248.299267889" Jun 11 23:36:33.781356 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.781273 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:36:33.910091 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.910048 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:36:33.910448 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.910157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971223 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971223 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4h9v\" (UniqueName: \"kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:33.971593 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:33.971442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072684 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072684 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072684 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4h9v\" (UniqueName: \"kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.072970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.072792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.073501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.073480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.073600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.073548 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.073600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.073589 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.073754 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.073731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.075491 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.075464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.075575 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.075464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.080157 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.080132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4h9v\" (UniqueName: \"kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v\") pod \"console-66998bd569-57k7h\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.219310 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.219267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:34.357870 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.357789 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:36:34.361438 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:34.361412 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee444f2_104a_407e_aa4a_b25ca0639aee.slice/crio-70825949d0711be8e330e4a12f9f788a63b05b9adfee5f0013d3cd475a90ca9e WatchSource:0}: Error finding container 70825949d0711be8e330e4a12f9f788a63b05b9adfee5f0013d3cd475a90ca9e: Status 404 returned error can't find the container with id 70825949d0711be8e330e4a12f9f788a63b05b9adfee5f0013d3cd475a90ca9e Jun 11 23:36:34.810204 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.810162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66998bd569-57k7h" event={"ID":"5ee444f2-104a-407e-aa4a-b25ca0639aee","Type":"ContainerStarted","Data":"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26"} Jun 11 23:36:34.810350 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.810221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66998bd569-57k7h" event={"ID":"5ee444f2-104a-407e-aa4a-b25ca0639aee","Type":"ContainerStarted","Data":"70825949d0711be8e330e4a12f9f788a63b05b9adfee5f0013d3cd475a90ca9e"} Jun 11 23:36:34.827709 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:34.827649 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66998bd569-57k7h" podStartSLOduration=1.8276333729999998 podStartE2EDuration="1.827633373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:34.826577689 +0000 UTC m=+249.344744129" watchObservedRunningTime="2026-06-11 23:36:34.827633373 +0000 UTC m=+249.345799801" Jun 11 23:36:35.773242 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:35.773203 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:35.773617 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:35.773251 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:37.068985 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.068946 2581 patch_prober.go:28] interesting pod/console-86f8d6bc9f-mg2v5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 23:36:37.069464 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.069040 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 23:36:37.683866 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.683830 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:37.684052 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.683883 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:37.903561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.903508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:36:37.905887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:37.905864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34d0819d-d6a5-4fb6-ad42-bcfafd7928da-metrics-certs\") pod \"network-metrics-daemon-wz62w\" (UID: \"34d0819d-d6a5-4fb6-ad42-bcfafd7928da\") " pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:36:38.180972 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:38.180943 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mx7t4\"" Jun 11 23:36:38.189711 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:38.189688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wz62w" Jun 11 23:36:38.324586 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:38.324551 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wz62w"] Jun 11 23:36:38.328434 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:36:38.328394 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d0819d_d6a5_4fb6_ad42_bcfafd7928da.slice/crio-c07234098ee872dfdf36d5d4b167f491afeff0d6d075e7da6d7d6a3b615e4120 WatchSource:0}: Error finding container c07234098ee872dfdf36d5d4b167f491afeff0d6d075e7da6d7d6a3b615e4120: Status 404 returned error can't find the container with id c07234098ee872dfdf36d5d4b167f491afeff0d6d075e7da6d7d6a3b615e4120 Jun 11 23:36:38.826180 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:38.826136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wz62w" event={"ID":"34d0819d-d6a5-4fb6-ad42-bcfafd7928da","Type":"ContainerStarted","Data":"c07234098ee872dfdf36d5d4b167f491afeff0d6d075e7da6d7d6a3b615e4120"} Jun 11 23:36:39.831675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:39.831640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wz62w" event={"ID":"34d0819d-d6a5-4fb6-ad42-bcfafd7928da","Type":"ContainerStarted","Data":"fef81c9dae1c9b2b21c430550ff1d2c94cfdc2f7e4fae91fe9fd11ad03f0cf6d"} Jun 11 23:36:39.832086 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:39.831696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wz62w" event={"ID":"34d0819d-d6a5-4fb6-ad42-bcfafd7928da","Type":"ContainerStarted","Data":"714752a9348be29c492c1c91d95334a97f743e4437d3a2ad92d39ba53a331aef"} Jun 11 23:36:39.848264 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:39.848214 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wz62w" podStartSLOduration=253.073886326 podStartE2EDuration="4m13.848200428s" totalImagesPullingTime="774.314102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:36:39.846741728 +0000 UTC m=+254.364908156" watchObservedRunningTime="2026-06-11 23:36:39.848200428 +0000 UTC m=+254.366366857" Jun 11 23:36:44.220249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:44.220207 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:44.220666 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:44.220285 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:36:44.221726 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:44.221694 2581 patch_prober.go:28] interesting pod/console-66998bd569-57k7h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 11 23:36:44.221819 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:44.221737 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-66998bd569-57k7h" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 11 23:36:45.773618 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.773583 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:45.774017 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.773633 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:45.774017 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.773676 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:36:45.774273 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.774231 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"195b6fb0ca55156c3dfe4f953f4e719309cfb0f0cd0260c92e2fb8e749703ee2"} pod="openshift-image-registry/image-registry-8454c7b78-87s58" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 23:36:45.777981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.777955 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:45.778122 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:45.778020 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:47.069227 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:47.069187 2581 patch_prober.go:28] interesting pod/console-86f8d6bc9f-mg2v5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 23:36:47.069608 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:47.069241 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 23:36:53.884881 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:53.884844 2581 generic.go:356] "Generic (PLEG): container finished" podID="1907afdf-750a-477e-8c00-65786f27783c" containerID="9e3a8d4f46f2fbbcf5feb7e824b7fc26a129eb4cdd5931f0ca99c03a77e68872" exitCode=0 Jun 11 23:36:53.885296 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:53.884917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" event={"ID":"1907afdf-750a-477e-8c00-65786f27783c","Type":"ContainerDied","Data":"9e3a8d4f46f2fbbcf5feb7e824b7fc26a129eb4cdd5931f0ca99c03a77e68872"} Jun 11 23:36:53.885342 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:53.885294 2581 scope.go:117] "RemoveContainer" containerID="9e3a8d4f46f2fbbcf5feb7e824b7fc26a129eb4cdd5931f0ca99c03a77e68872" Jun 11 23:36:54.220133 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:54.220082 2581 patch_prober.go:28] interesting pod/console-66998bd569-57k7h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 11 23:36:54.220310 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:54.220152 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-66998bd569-57k7h" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 11 23:36:54.890760 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:54.890723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-c6vf8" event={"ID":"1907afdf-750a-477e-8c00-65786f27783c","Type":"ContainerStarted","Data":"e01d6dab25bbbfd3d09b0133ff93dfac7e9e410c36c6426cfba4c755d082d1bc"} Jun 11 23:36:55.778402 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:55.778367 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:36:55.778568 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:55.778415 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:36:57.069637 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:57.069596 2581 patch_prober.go:28] interesting pod/console-86f8d6bc9f-mg2v5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 23:36:57.070038 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:57.069648 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 23:36:58.905940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:58.905904 2581 generic.go:356] "Generic (PLEG): container finished" podID="1a38ace0-cef8-4e0a-8f4d-031393d6366c" containerID="e426399f4cb7c0fdceec739b8d516ba8363611dcfd431e0965333a89cccf77ff" exitCode=0 Jun 11 23:36:58.905940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:58.905943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" event={"ID":"1a38ace0-cef8-4e0a-8f4d-031393d6366c","Type":"ContainerDied","Data":"e426399f4cb7c0fdceec739b8d516ba8363611dcfd431e0965333a89cccf77ff"} Jun 11 23:36:58.906397 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:58.906265 2581 scope.go:117] "RemoveContainer" containerID="e426399f4cb7c0fdceec739b8d516ba8363611dcfd431e0965333a89cccf77ff" Jun 11 23:36:59.911400 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:36:59.911363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-82dwg" event={"ID":"1a38ace0-cef8-4e0a-8f4d-031393d6366c","Type":"ContainerStarted","Data":"7fd0eb804a37e73dc7c235819d14c0816cc20bfac4dd380ce667f03f0617309d"} Jun 11 23:37:03.929041 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:03.928982 2581 generic.go:356] "Generic (PLEG): container finished" podID="f69708d0-9206-4442-a3d7-d43c91d7eb4a" containerID="45679cedc2aab526158844becee7b0c0c25d6695d3f655fe76c4ceec70d0d4c1" exitCode=0 Jun 11 23:37:03.929501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:03.929056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" event={"ID":"f69708d0-9206-4442-a3d7-d43c91d7eb4a","Type":"ContainerDied","Data":"45679cedc2aab526158844becee7b0c0c25d6695d3f655fe76c4ceec70d0d4c1"} Jun 11 23:37:03.929501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:03.929398 2581 scope.go:117] "RemoveContainer" containerID="45679cedc2aab526158844becee7b0c0c25d6695d3f655fe76c4ceec70d0d4c1" Jun 11 23:37:04.219685 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:04.219653 2581 patch_prober.go:28] interesting pod/console-66998bd569-57k7h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 11 23:37:04.219875 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:04.219700 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-66998bd569-57k7h" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 11 23:37:04.934589 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:04.934549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-77zts" event={"ID":"f69708d0-9206-4442-a3d7-d43c91d7eb4a","Type":"ContainerStarted","Data":"d8a1c8b49a126901554f095d32601506897c29b0142ca5998389db75117b204d"} Jun 11 23:37:05.777864 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:05.777830 2581 patch_prober.go:28] interesting pod/image-registry-8454c7b78-87s58 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 23:37:05.778037 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:05.777884 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:37:07.069762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:07.069724 2581 patch_prober.go:28] interesting pod/console-86f8d6bc9f-mg2v5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 23:37:07.070173 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:07.069783 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 23:37:07.485060 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:37:07.485021 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sxggh" podUID="733fcfd5-13a6-4d08-9d1c-f9c37004bb83" Jun 11 23:37:07.946146 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:07.946114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:10.793600 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:10.793548 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8454c7b78-87s58" podUID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerName="registry" containerID="cri-o://195b6fb0ca55156c3dfe4f953f4e719309cfb0f0cd0260c92e2fb8e749703ee2" gracePeriod=30 Jun 11 23:37:10.897831 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:10.897792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:10.900111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:10.900094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733fcfd5-13a6-4d08-9d1c-f9c37004bb83-metrics-tls\") pod \"dns-default-sxggh\" (UID: \"733fcfd5-13a6-4d08-9d1c-f9c37004bb83\") " pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:10.949128 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:10.949097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krlkn\"" Jun 11 23:37:10.957661 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:10.957633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:11.087649 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:11.087569 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxggh"] Jun 11 23:37:11.090655 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:37:11.090629 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733fcfd5_13a6_4d08_9d1c_f9c37004bb83.slice/crio-5e6041ad8d228642ea5c94c2d3d10e59d4c6813f9eb660171ba367b84e59abe1 WatchSource:0}: Error finding container 5e6041ad8d228642ea5c94c2d3d10e59d4c6813f9eb660171ba367b84e59abe1: Status 404 returned error can't find the container with id 5e6041ad8d228642ea5c94c2d3d10e59d4c6813f9eb660171ba367b84e59abe1 Jun 11 23:37:11.963450 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:11.963415 2581 generic.go:356] "Generic (PLEG): container finished" podID="dd1399bf-05af-484f-ab2f-35b77b9926c2" containerID="195b6fb0ca55156c3dfe4f953f4e719309cfb0f0cd0260c92e2fb8e749703ee2" exitCode=0 Jun 11 23:37:11.963877 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:11.963499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8454c7b78-87s58" event={"ID":"dd1399bf-05af-484f-ab2f-35b77b9926c2","Type":"ContainerDied","Data":"195b6fb0ca55156c3dfe4f953f4e719309cfb0f0cd0260c92e2fb8e749703ee2"} Jun 11 23:37:11.965029 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:11.964970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxggh" event={"ID":"733fcfd5-13a6-4d08-9d1c-f9c37004bb83","Type":"ContainerStarted","Data":"5e6041ad8d228642ea5c94c2d3d10e59d4c6813f9eb660171ba367b84e59abe1"} Jun 11 23:37:12.970263 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:12.970226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8454c7b78-87s58" event={"ID":"dd1399bf-05af-484f-ab2f-35b77b9926c2","Type":"ContainerStarted","Data":"f26cfda634da71657d63104bd39c49a00d837e309ecee60096efeaff6ed529fe"} Jun 11 23:37:12.970735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:12.970329 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:37:12.972041 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:12.972010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxggh" event={"ID":"733fcfd5-13a6-4d08-9d1c-f9c37004bb83","Type":"ContainerStarted","Data":"4bb1cbe59cf6c5aceeadb5e389fa5df10cfafefa518260d2db7e8e47a175595d"} Jun 11 23:37:12.972118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:12.972061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxggh" event={"ID":"733fcfd5-13a6-4d08-9d1c-f9c37004bb83","Type":"ContainerStarted","Data":"2176271af9b575d890189ef20eb19fcf0c93dabb89510e918ac2c08ceac41b2d"} Jun 11 23:37:12.972118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:12.972083 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:13.005659 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:13.005590 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sxggh" podStartSLOduration=251.479868755 podStartE2EDuration="4m13.005573218s" totalImagesPullingTime="1.525704463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:37:13.004437122 +0000 UTC m=+287.522603552" watchObservedRunningTime="2026-06-11 23:37:13.005573218 +0000 UTC m=+287.523739646" Jun 11 23:37:14.220170 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:14.220134 2581 patch_prober.go:28] interesting pod/console-66998bd569-57k7h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body= Jun 11 23:37:14.220576 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:14.220187 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-66998bd569-57k7h" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" Jun 11 23:37:17.073386 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:17.073355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:37:17.077090 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:17.077058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:37:22.979219 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:22.979182 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sxggh" Jun 11 23:37:24.223743 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:24.223706 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:37:24.227711 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:24.227684 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:37:24.284381 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:24.284349 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:37:25.934622 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:25.934589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:37:25.938587 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:25.938563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:37:25.939382 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:25.939357 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 23:37:33.981846 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:33.981813 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8454c7b78-87s58" Jun 11 23:37:49.307915 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.307843 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86f8d6bc9f-mg2v5" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" containerID="cri-o://bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d" gracePeriod=15 Jun 11 23:37:49.559863 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.559803 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:37:49.726981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.726945 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727177 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727177 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727271 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727189 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727415 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727386 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6h4x\" (UniqueName: \"kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727490 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727430 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727490 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727435 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:37:49.727490 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727458 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config\") pod \"0674b48a-79d0-43bb-989f-fbac2d5392d3\" (UID: \"0674b48a-79d0-43bb-989f-fbac2d5392d3\") " Jun 11 23:37:49.727627 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727538 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:37:49.727781 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727734 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-service-ca\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.727781 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727759 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-trusted-ca-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.727910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727777 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:37:49.727910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.727821 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config" (OuterVolumeSpecName: "console-config") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:37:49.729514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.729490 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:37:49.729610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.729536 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x" (OuterVolumeSpecName: "kube-api-access-n6h4x") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "kube-api-access-n6h4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:37:49.729700 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.729681 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0674b48a-79d0-43bb-989f-fbac2d5392d3" (UID: "0674b48a-79d0-43bb-989f-fbac2d5392d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:37:49.829105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.828957 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.829105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.829037 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-oauth-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.829105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.829051 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6h4x\" (UniqueName: \"kubernetes.io/projected/0674b48a-79d0-43bb-989f-fbac2d5392d3-kube-api-access-n6h4x\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.829105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.829064 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-oauth-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:49.829105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:49.829076 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0674b48a-79d0-43bb-989f-fbac2d5392d3-console-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:37:50.120591 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.120509 2581 generic.go:356] "Generic (PLEG): container finished" podID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerID="bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d" exitCode=0 Jun 11 23:37:50.120591 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.120557 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8d6bc9f-mg2v5" Jun 11 23:37:50.120591 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.120565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8d6bc9f-mg2v5" event={"ID":"0674b48a-79d0-43bb-989f-fbac2d5392d3","Type":"ContainerDied","Data":"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d"} Jun 11 23:37:50.120806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.120605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8d6bc9f-mg2v5" event={"ID":"0674b48a-79d0-43bb-989f-fbac2d5392d3","Type":"ContainerDied","Data":"4de043839c8d8b43b5fde8d137ee3ba96cb809389e5576d7017856eff53e93d1"} Jun 11 23:37:50.120806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.120625 2581 scope.go:117] "RemoveContainer" containerID="bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d" Jun 11 23:37:50.129073 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.129053 2581 scope.go:117] "RemoveContainer" containerID="bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d" Jun 11 23:37:50.129382 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:37:50.129357 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d\": container with ID starting with bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d not found: ID does not exist" containerID="bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d" Jun 11 23:37:50.129469 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.129395 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d"} err="failed to get container status \"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d\": rpc error: code = NotFound desc = could not find container \"bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d\": container with ID starting with bea2ad07aef1baee2261803a6a6c6fe5f406958a9cbb98f6e569f766d6b63d9d not found: ID does not exist" Jun 11 23:37:50.135899 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.135872 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:37:50.139707 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:50.139683 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f8d6bc9f-mg2v5"] Jun 11 23:37:51.981367 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:51.981330 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" path="/var/lib/kubelet/pods/0674b48a-79d0-43bb-989f-fbac2d5392d3/volumes" Jun 11 23:37:53.098348 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.098306 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c8c566d68-kzxfp"] Jun 11 23:37:53.098749 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.098719 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" Jun 11 23:37:53.098749 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.098738 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" Jun 11 23:37:53.098850 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.098815 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0674b48a-79d0-43bb-989f-fbac2d5392d3" containerName="console" Jun 11 23:37:53.107367 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.107328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.110385 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.110343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 23:37:53.111265 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.111242 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2gkwd\"" Jun 11 23:37:53.111507 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.111272 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 23:37:53.111589 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.111284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 23:37:53.111644 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.111615 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 23:37:53.111644 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.111370 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 23:37:53.112430 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.112408 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c8c566d68-kzxfp"] Jun 11 23:37:53.116024 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.115645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 23:37:53.253675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-federate-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-serving-certs-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgsl4\" (UniqueName: \"kubernetes.io/projected/bf59e35e-54d0-44e9-896c-2baa0229dcfc-kube-api-access-sgsl4\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-metrics-client-ca\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.253903 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.253899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.354852 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.354852 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-federate-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-serving-certs-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.354982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsl4\" (UniqueName: \"kubernetes.io/projected/bf59e35e-54d0-44e9-896c-2baa0229dcfc-kube-api-access-sgsl4\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355121 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.355081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-metrics-client-ca\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355724 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.355672 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-serving-certs-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.355724 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.355691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-metrics-client-ca\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.356252 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.356227 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.357582 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.357556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.357714 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.357698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.357756 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.357744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-federate-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.358085 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.358068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf59e35e-54d0-44e9-896c-2baa0229dcfc-telemeter-client-tls\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.362707 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.362682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsl4\" (UniqueName: \"kubernetes.io/projected/bf59e35e-54d0-44e9-896c-2baa0229dcfc-kube-api-access-sgsl4\") pod \"telemeter-client-6c8c566d68-kzxfp\" (UID: \"bf59e35e-54d0-44e9-896c-2baa0229dcfc\") " pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.418421 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.418381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" Jun 11 23:37:53.559449 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.559415 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c8c566d68-kzxfp"] Jun 11 23:37:53.562758 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:37:53.562730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf59e35e_54d0_44e9_896c_2baa0229dcfc.slice/crio-7e1a8c8db261d1dc0b568f2e13aabb1ab8a7ddf5695fb189a2d5b8e2e9e4dbee WatchSource:0}: Error finding container 7e1a8c8db261d1dc0b568f2e13aabb1ab8a7ddf5695fb189a2d5b8e2e9e4dbee: Status 404 returned error can't find the container with id 7e1a8c8db261d1dc0b568f2e13aabb1ab8a7ddf5695fb189a2d5b8e2e9e4dbee Jun 11 23:37:53.564741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:53.564724 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:37:54.138261 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:54.138222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" event={"ID":"bf59e35e-54d0-44e9-896c-2baa0229dcfc","Type":"ContainerStarted","Data":"7e1a8c8db261d1dc0b568f2e13aabb1ab8a7ddf5695fb189a2d5b8e2e9e4dbee"} Jun 11 23:37:56.147620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:56.147588 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" event={"ID":"bf59e35e-54d0-44e9-896c-2baa0229dcfc","Type":"ContainerStarted","Data":"ee80d778cbe12c263c8528237e3a70ea8b702cd5fd5d296a0e66877fcd95554a"} Jun 11 23:37:57.156378 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.156342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" event={"ID":"bf59e35e-54d0-44e9-896c-2baa0229dcfc","Type":"ContainerStarted","Data":"f99a75174654c935448c973c0dd6f4ba8fbe494223df3e16bdb7a73858ae9d5d"} Jun 11 23:37:57.156787 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.156405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" event={"ID":"bf59e35e-54d0-44e9-896c-2baa0229dcfc","Type":"ContainerStarted","Data":"5de5cd8c1d51446f8d43768246a7272e8070fa69ffd9176504b0f75f5fcde309"} Jun 11 23:37:57.179160 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.179104 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c8c566d68-kzxfp" podStartSLOduration=1.671418734 podStartE2EDuration="4.17907943s" totalImagesPullingTime="2.507660696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:37:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:37:57.176563945 +0000 UTC m=+331.694730373" watchObservedRunningTime="2026-06-11 23:37:57.17907943 +0000 UTC m=+331.697245858" Jun 11 23:37:57.908529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.908491 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:37:57.911973 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.911944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:57.923310 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:57.923282 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:37:58.096703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.096703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.096978 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59q8x\" (UniqueName: \"kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.096978 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.096978 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.096978 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.096966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.097188 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.097052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.197513 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.197513 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59q8x\" (UniqueName: \"kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.197743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198424 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.198368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198424 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.198369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198542 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.198516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.198674 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.198647 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.200335 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.200302 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.200577 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.200559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.206440 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.206405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59q8x\" (UniqueName: \"kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x\") pod \"console-f8975bdc-5x89g\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.222158 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.222120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:37:58.361259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:58.361232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:37:58.363526 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:37:58.363495 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab67358b_340d_4f52_bf1e_5d144a4c7b03.slice/crio-c84bb44e28f29b91d35c6a3f701b85361351750a7e8d3b20bb4db3e78ab4d37c WatchSource:0}: Error finding container c84bb44e28f29b91d35c6a3f701b85361351750a7e8d3b20bb4db3e78ab4d37c: Status 404 returned error can't find the container with id c84bb44e28f29b91d35c6a3f701b85361351750a7e8d3b20bb4db3e78ab4d37c Jun 11 23:37:59.165498 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:59.165463 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8975bdc-5x89g" event={"ID":"ab67358b-340d-4f52-bf1e-5d144a4c7b03","Type":"ContainerStarted","Data":"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9"} Jun 11 23:37:59.165675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:59.165514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8975bdc-5x89g" event={"ID":"ab67358b-340d-4f52-bf1e-5d144a4c7b03","Type":"ContainerStarted","Data":"c84bb44e28f29b91d35c6a3f701b85361351750a7e8d3b20bb4db3e78ab4d37c"} Jun 11 23:37:59.182776 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:37:59.182719 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f8975bdc-5x89g" podStartSLOduration=2.182700143 podStartE2EDuration="2.182700143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:37:59.181544237 +0000 UTC m=+333.699710666" watchObservedRunningTime="2026-06-11 23:37:59.182700143 +0000 UTC m=+333.700866642" Jun 11 23:38:03.573805 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.573770 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:38:03.605765 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.605725 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5899dcdb5d-ww4vj"] Jun 11 23:38:03.609140 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.609120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.619887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.619853 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5899dcdb5d-ww4vj"] Jun 11 23:38:03.636307 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-trusted-ca-bundle\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-service-ca\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-oauth-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngzd\" (UniqueName: \"kubernetes.io/projected/b2c7536f-3313-4746-bc79-54c9dbcf29ed-kube-api-access-pngzd\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.636503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.636475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-oauth-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-oauth-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-trusted-ca-bundle\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-service-ca\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-oauth-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.737735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.737698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngzd\" (UniqueName: \"kubernetes.io/projected/b2c7536f-3313-4746-bc79-54c9dbcf29ed-kube-api-access-pngzd\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.738370 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.738344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.738454 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.738346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-oauth-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.738494 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.738446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-service-ca\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.738578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.738562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c7536f-3313-4746-bc79-54c9dbcf29ed-trusted-ca-bundle\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.740741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.740712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-oauth-config\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.740832 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.740792 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c7536f-3313-4746-bc79-54c9dbcf29ed-console-serving-cert\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.745388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.745363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngzd\" (UniqueName: \"kubernetes.io/projected/b2c7536f-3313-4746-bc79-54c9dbcf29ed-kube-api-access-pngzd\") pod \"console-5899dcdb5d-ww4vj\" (UID: \"b2c7536f-3313-4746-bc79-54c9dbcf29ed\") " pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:03.919727 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:03.919693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:04.058920 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:04.058881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5899dcdb5d-ww4vj"] Jun 11 23:38:04.062044 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:38:04.062012 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c7536f_3313_4746_bc79_54c9dbcf29ed.slice/crio-9a21a152f5751825ce6da66012630c24f8b29da505c746dd1c4d3b4e4eca1b2f WatchSource:0}: Error finding container 9a21a152f5751825ce6da66012630c24f8b29da505c746dd1c4d3b4e4eca1b2f: Status 404 returned error can't find the container with id 9a21a152f5751825ce6da66012630c24f8b29da505c746dd1c4d3b4e4eca1b2f Jun 11 23:38:04.187974 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:04.187935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5899dcdb5d-ww4vj" event={"ID":"b2c7536f-3313-4746-bc79-54c9dbcf29ed","Type":"ContainerStarted","Data":"b6bd3f94f33d91c69403329cf92241274c5da4bae8664940fff73cee8d7cc5f5"} Jun 11 23:38:04.188159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:04.188015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5899dcdb5d-ww4vj" event={"ID":"b2c7536f-3313-4746-bc79-54c9dbcf29ed","Type":"ContainerStarted","Data":"9a21a152f5751825ce6da66012630c24f8b29da505c746dd1c4d3b4e4eca1b2f"} Jun 11 23:38:04.204863 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:04.204802 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5899dcdb5d-ww4vj" podStartSLOduration=1.204784865 podStartE2EDuration="1.204784865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:38:04.204312745 +0000 UTC m=+338.722479175" watchObservedRunningTime="2026-06-11 23:38:04.204784865 +0000 UTC m=+338.722951293" Jun 11 23:38:08.222768 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:08.222656 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:38:13.920431 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:13.920373 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:13.920907 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:13.920458 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:13.925357 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:13.925328 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:14.234338 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:14.234251 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5899dcdb5d-ww4vj" Jun 11 23:38:14.277284 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:14.277246 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:38:28.593829 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.593777 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f8975bdc-5x89g" podUID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" containerName="console" containerID="cri-o://de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9" gracePeriod=15 Jun 11 23:38:28.845910 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.845836 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:38:28.953648 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953610 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953648 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953650 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953891 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953677 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953891 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953754 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953891 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953805 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953891 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953838 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.953891 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.953873 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59q8x\" (UniqueName: \"kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x\") pod \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\" (UID: \"ab67358b-340d-4f52-bf1e-5d144a4c7b03\") " Jun 11 23:38:28.954236 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.954115 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:28.954294 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.954159 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:28.954294 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.954203 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config" (OuterVolumeSpecName: "console-config") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:28.954408 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.954337 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:28.956279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.956249 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:28.956376 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.956254 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x" (OuterVolumeSpecName: "kube-api-access-59q8x") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "kube-api-access-59q8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:38:28.956376 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:28.956340 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab67358b-340d-4f52-bf1e-5d144a4c7b03" (UID: "ab67358b-340d-4f52-bf1e-5d144a4c7b03"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:29.055484 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055437 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055484 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055473 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055484 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055484 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab67358b-340d-4f52-bf1e-5d144a4c7b03-console-oauth-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055484 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055494 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59q8x\" (UniqueName: \"kubernetes.io/projected/ab67358b-340d-4f52-bf1e-5d144a4c7b03-kube-api-access-59q8x\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055759 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055503 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-oauth-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055759 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055512 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-service-ca\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.055759 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.055521 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab67358b-340d-4f52-bf1e-5d144a4c7b03-trusted-ca-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:29.293905 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.293865 2581 generic.go:356] "Generic (PLEG): container finished" podID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" containerID="de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9" exitCode=0 Jun 11 23:38:29.294111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.293912 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8975bdc-5x89g" Jun 11 23:38:29.294111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.293957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8975bdc-5x89g" event={"ID":"ab67358b-340d-4f52-bf1e-5d144a4c7b03","Type":"ContainerDied","Data":"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9"} Jun 11 23:38:29.294111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.294040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8975bdc-5x89g" event={"ID":"ab67358b-340d-4f52-bf1e-5d144a4c7b03","Type":"ContainerDied","Data":"c84bb44e28f29b91d35c6a3f701b85361351750a7e8d3b20bb4db3e78ab4d37c"} Jun 11 23:38:29.294111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.294064 2581 scope.go:117] "RemoveContainer" containerID="de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9" Jun 11 23:38:29.303422 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.303399 2581 scope.go:117] "RemoveContainer" containerID="de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9" Jun 11 23:38:29.303738 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:38:29.303714 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9\": container with ID starting with de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9 not found: ID does not exist" containerID="de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9" Jun 11 23:38:29.303798 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.303749 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9"} err="failed to get container status \"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9\": rpc error: code = NotFound desc = could not find container \"de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9\": container with ID starting with de0042359056e2708272836167e8c5fa0bb406db2efa3da1b8a1282d9bf7b3f9 not found: ID does not exist" Jun 11 23:38:29.314432 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.314393 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:38:29.319969 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.319938 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f8975bdc-5x89g"] Jun 11 23:38:29.981922 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:29.981883 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" path="/var/lib/kubelet/pods/ab67358b-340d-4f52-bf1e-5d144a4c7b03/volumes" Jun 11 23:38:39.298468 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.298398 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66998bd569-57k7h" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" containerID="cri-o://3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26" gracePeriod=15 Jun 11 23:38:39.552620 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.552546 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:38:39.645429 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645609 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645491 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645685 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645658 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4h9v\" (UniqueName: \"kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645729 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645710 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645767 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645746 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645818 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645796 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645878 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645837 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle\") pod \"5ee444f2-104a-407e-aa4a-b25ca0639aee\" (UID: \"5ee444f2-104a-407e-aa4a-b25ca0639aee\") " Jun 11 23:38:39.645878 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645841 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:39.645878 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.645845 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config" (OuterVolumeSpecName: "console-config") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:39.646141 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.646121 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-service-ca\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.646208 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.646146 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.646250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.646235 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:39.646347 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.646325 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 23:38:39.647825 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.647800 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v" (OuterVolumeSpecName: "kube-api-access-x4h9v") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "kube-api-access-x4h9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:38:39.648325 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.648305 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:39.648388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.648330 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ee444f2-104a-407e-aa4a-b25ca0639aee" (UID: "5ee444f2-104a-407e-aa4a-b25ca0639aee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:38:39.746674 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.746639 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-oauth-config\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.746674 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.746670 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-oauth-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.746674 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.746679 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ee444f2-104a-407e-aa4a-b25ca0639aee-trusted-ca-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.746966 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.746689 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4h9v\" (UniqueName: \"kubernetes.io/projected/5ee444f2-104a-407e-aa4a-b25ca0639aee-kube-api-access-x4h9v\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:39.746966 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:39.746700 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ee444f2-104a-407e-aa4a-b25ca0639aee-console-serving-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:38:40.345659 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.345565 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerID="3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26" exitCode=0 Jun 11 23:38:40.345659 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.345638 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66998bd569-57k7h" Jun 11 23:38:40.345659 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.345641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66998bd569-57k7h" event={"ID":"5ee444f2-104a-407e-aa4a-b25ca0639aee","Type":"ContainerDied","Data":"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26"} Jun 11 23:38:40.346191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.345721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66998bd569-57k7h" event={"ID":"5ee444f2-104a-407e-aa4a-b25ca0639aee","Type":"ContainerDied","Data":"70825949d0711be8e330e4a12f9f788a63b05b9adfee5f0013d3cd475a90ca9e"} Jun 11 23:38:40.346191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.345745 2581 scope.go:117] "RemoveContainer" containerID="3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26" Jun 11 23:38:40.354684 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.354663 2581 scope.go:117] "RemoveContainer" containerID="3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26" Jun 11 23:38:40.355034 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:38:40.355012 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26\": container with ID starting with 3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26 not found: ID does not exist" containerID="3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26" Jun 11 23:38:40.355083 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.355047 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26"} err="failed to get container status \"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26\": rpc error: code = NotFound desc = could not find container \"3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26\": container with ID starting with 3db8aef980cb9d3183fe36157ba04b5d23718ec9836313bd68cff455f2418b26 not found: ID does not exist" Jun 11 23:38:40.360767 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.360734 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:38:40.363399 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:40.363372 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66998bd569-57k7h"] Jun 11 23:38:41.981370 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:38:41.981334 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" path="/var/lib/kubelet/pods/5ee444f2-104a-407e-aa4a-b25ca0639aee/volumes" Jun 11 23:39:12.993967 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.993919 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc"] Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994367 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994385 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994428 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" containerName="console" Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994438 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" containerName="console" Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994516 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab67358b-340d-4f52-bf1e-5d144a4c7b03" containerName="console" Jun 11 23:39:12.994537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.994527 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee444f2-104a-407e-aa4a-b25ca0639aee" containerName="console" Jun 11 23:39:12.997447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:12.997423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.000755 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.000727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:39:13.001566 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.001536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:39:13.001566 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.001550 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:39:13.006388 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.006358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc"] Jun 11 23:39:13.035197 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.035164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.035364 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.035226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwft\" (UniqueName: \"kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.035364 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.035290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.136249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.136200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwft\" (UniqueName: \"kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.136453 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.136262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.136453 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.136303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.136705 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.136678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.136811 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.136698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.144919 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.144890 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwft\" (UniqueName: \"kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.307446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.307346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:13.445636 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.445602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc"] Jun 11 23:39:13.449315 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:39:13.449286 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699d3a73_cab3_4793_b173_cfd8e5966b24.slice/crio-1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e WatchSource:0}: Error finding container 1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e: Status 404 returned error can't find the container with id 1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e Jun 11 23:39:13.478136 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:13.478098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" event={"ID":"699d3a73-cab3-4793-b173-cfd8e5966b24","Type":"ContainerStarted","Data":"1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e"} Jun 11 23:39:19.505847 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:19.505809 2581 generic.go:356] "Generic (PLEG): container finished" podID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerID="f29611f933fc524fff664d48eb3a94c5ea2becf8de3f75bd2e0bbbabeaf5b2de" exitCode=0 Jun 11 23:39:19.506239 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:19.505867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" event={"ID":"699d3a73-cab3-4793-b173-cfd8e5966b24","Type":"ContainerDied","Data":"f29611f933fc524fff664d48eb3a94c5ea2becf8de3f75bd2e0bbbabeaf5b2de"} Jun 11 23:39:22.520492 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:22.520452 2581 generic.go:356] "Generic (PLEG): container finished" podID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerID="fda25c3df190b2c71927953e92eca2da1c1693f242370b77ad1baa1dd80f4e2e" exitCode=0 Jun 11 23:39:22.520880 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:22.520504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" event={"ID":"699d3a73-cab3-4793-b173-cfd8e5966b24","Type":"ContainerDied","Data":"fda25c3df190b2c71927953e92eca2da1c1693f242370b77ad1baa1dd80f4e2e"} Jun 11 23:39:29.552446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:29.552356 2581 generic.go:356] "Generic (PLEG): container finished" podID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerID="5c9efdf63a7fdace38a8a0da5acf076a8d804e1eda29b4a050e2f1e8c8aea531" exitCode=0 Jun 11 23:39:29.552789 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:29.552447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" event={"ID":"699d3a73-cab3-4793-b173-cfd8e5966b24","Type":"ContainerDied","Data":"5c9efdf63a7fdace38a8a0da5acf076a8d804e1eda29b4a050e2f1e8c8aea531"} Jun 11 23:39:30.681162 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.681128 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:30.803463 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.803427 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util\") pod \"699d3a73-cab3-4793-b173-cfd8e5966b24\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " Jun 11 23:39:30.803661 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.803501 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwwft\" (UniqueName: \"kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft\") pod \"699d3a73-cab3-4793-b173-cfd8e5966b24\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " Jun 11 23:39:30.803661 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.803541 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle\") pod \"699d3a73-cab3-4793-b173-cfd8e5966b24\" (UID: \"699d3a73-cab3-4793-b173-cfd8e5966b24\") " Jun 11 23:39:30.804249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.804224 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle" (OuterVolumeSpecName: "bundle") pod "699d3a73-cab3-4793-b173-cfd8e5966b24" (UID: "699d3a73-cab3-4793-b173-cfd8e5966b24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:39:30.805821 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.805800 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft" (OuterVolumeSpecName: "kube-api-access-bwwft") pod "699d3a73-cab3-4793-b173-cfd8e5966b24" (UID: "699d3a73-cab3-4793-b173-cfd8e5966b24"). InnerVolumeSpecName "kube-api-access-bwwft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:39:30.808445 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.808385 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util" (OuterVolumeSpecName: "util") pod "699d3a73-cab3-4793-b173-cfd8e5966b24" (UID: "699d3a73-cab3-4793-b173-cfd8e5966b24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:39:30.904290 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.904249 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:30.904290 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.904279 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/699d3a73-cab3-4793-b173-cfd8e5966b24-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:30.904290 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:30.904288 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwwft\" (UniqueName: \"kubernetes.io/projected/699d3a73-cab3-4793-b173-cfd8e5966b24-kube-api-access-bwwft\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:31.561934 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:31.561905 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" Jun 11 23:39:31.562123 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:31.561899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19db5nqc" event={"ID":"699d3a73-cab3-4793-b173-cfd8e5966b24","Type":"ContainerDied","Data":"1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e"} Jun 11 23:39:31.562123 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:31.562043 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1054e7a992e15607a0019f81252c314bd18c16415e84c8c37efb481a5742803e" Jun 11 23:39:35.877448 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877407 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7"] Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877738 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="pull" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877751 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="pull" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877769 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="extract" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877777 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="extract" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877805 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="util" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877811 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="util" Jun 11 23:39:35.877929 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.877875 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="699d3a73-cab3-4793-b173-cfd8e5966b24" containerName="extract" Jun 11 23:39:35.924128 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.924087 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7"] Jun 11 23:39:35.924304 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.924215 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:35.927222 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.927196 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:39:35.927380 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.927295 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 23:39:35.927452 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:35.927436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xs8m4\"" Jun 11 23:39:36.049127 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.049083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099aa42a-4622-44a0-baa0-ed9f116e347a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.049338 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.049238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdv5v\" (UniqueName: \"kubernetes.io/projected/099aa42a-4622-44a0-baa0-ed9f116e347a-kube-api-access-pdv5v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.149769 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.149667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv5v\" (UniqueName: \"kubernetes.io/projected/099aa42a-4622-44a0-baa0-ed9f116e347a-kube-api-access-pdv5v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.149769 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.149736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099aa42a-4622-44a0-baa0-ed9f116e347a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.150225 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.150198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/099aa42a-4622-44a0-baa0-ed9f116e347a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.157940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.157917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdv5v\" (UniqueName: \"kubernetes.io/projected/099aa42a-4622-44a0-baa0-ed9f116e347a-kube-api-access-pdv5v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-l5cd7\" (UID: \"099aa42a-4622-44a0-baa0-ed9f116e347a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.234155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.234112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" Jun 11 23:39:36.406573 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.406544 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7"] Jun 11 23:39:36.409605 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:39:36.409571 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099aa42a_4622_44a0_baa0_ed9f116e347a.slice/crio-c87d89dab3682b3f0334147e1558362e1eeb2893c8d0c9b9950d9774cd7d12f5 WatchSource:0}: Error finding container c87d89dab3682b3f0334147e1558362e1eeb2893c8d0c9b9950d9774cd7d12f5: Status 404 returned error can't find the container with id c87d89dab3682b3f0334147e1558362e1eeb2893c8d0c9b9950d9774cd7d12f5 Jun 11 23:39:36.583051 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:36.583014 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" event={"ID":"099aa42a-4622-44a0-baa0-ed9f116e347a","Type":"ContainerStarted","Data":"c87d89dab3682b3f0334147e1558362e1eeb2893c8d0c9b9950d9774cd7d12f5"} Jun 11 23:39:39.599281 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:39.599245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" event={"ID":"099aa42a-4622-44a0-baa0-ed9f116e347a","Type":"ContainerStarted","Data":"2f8109a65e8ac7eeb2f81133ce18a9644f727bee9db72b728941a155a957609d"} Jun 11 23:39:39.648399 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:39.648334 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-l5cd7" podStartSLOduration=2.452517558 podStartE2EDuration="4.648314017s" totalImagesPullingTime="2.195796459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:39.646857268 +0000 UTC m=+434.165023698" watchObservedRunningTime="2026-06-11 23:39:39.648314017 +0000 UTC m=+434.166480444" Jun 11 23:39:40.441798 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.441759 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc"] Jun 11 23:39:40.459823 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.459794 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc"] Jun 11 23:39:40.459979 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.459903 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.462564 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.462533 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:39:40.462681 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.462593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:39:40.463396 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.463381 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:39:40.586569 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.586535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.586746 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.586578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.586746 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.586607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p9p2\" (UniqueName: \"kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.687782 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.687742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.688266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.687795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.688266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.687913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p9p2\" (UniqueName: \"kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.688266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.688152 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.688266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.688188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.696684 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.696618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p9p2\" (UniqueName: \"kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.771124 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.771082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:40.925603 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:40.925572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc"] Jun 11 23:39:40.928317 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:39:40.928276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19c304d_816b_4dc3_9a53_d01da6708731.slice/crio-a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152 WatchSource:0}: Error finding container a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152: Status 404 returned error can't find the container with id a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152 Jun 11 23:39:41.608975 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:41.608936 2581 generic.go:356] "Generic (PLEG): container finished" podID="e19c304d-816b-4dc3-9a53-d01da6708731" containerID="1851b1437397fb05d0c33e80e754082bfebabd0e84dc6d83d4d50883cd7a116f" exitCode=0 Jun 11 23:39:41.609199 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:41.609019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" event={"ID":"e19c304d-816b-4dc3-9a53-d01da6708731","Type":"ContainerDied","Data":"1851b1437397fb05d0c33e80e754082bfebabd0e84dc6d83d4d50883cd7a116f"} Jun 11 23:39:41.609199 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:41.609075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" event={"ID":"e19c304d-816b-4dc3-9a53-d01da6708731","Type":"ContainerStarted","Data":"a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152"} Jun 11 23:39:44.626657 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:44.626617 2581 generic.go:356] "Generic (PLEG): container finished" podID="e19c304d-816b-4dc3-9a53-d01da6708731" containerID="b647c7b5651b5ea12f31c6de0a8c2f527dd4d55d3af7e3929f9706eb0368d3c7" exitCode=0 Jun 11 23:39:44.627079 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:44.626701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" event={"ID":"e19c304d-816b-4dc3-9a53-d01da6708731","Type":"ContainerDied","Data":"b647c7b5651b5ea12f31c6de0a8c2f527dd4d55d3af7e3929f9706eb0368d3c7"} Jun 11 23:39:45.633775 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:45.633741 2581 generic.go:356] "Generic (PLEG): container finished" podID="e19c304d-816b-4dc3-9a53-d01da6708731" containerID="d30c69ef173f24d9e7f2bdbcc06b8249816098e7bfe54fd80e7090646d711fe5" exitCode=0 Jun 11 23:39:45.634187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:45.633824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" event={"ID":"e19c304d-816b-4dc3-9a53-d01da6708731","Type":"ContainerDied","Data":"d30c69ef173f24d9e7f2bdbcc06b8249816098e7bfe54fd80e7090646d711fe5"} Jun 11 23:39:46.771243 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.771216 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:46.841055 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.841024 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p9p2\" (UniqueName: \"kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2\") pod \"e19c304d-816b-4dc3-9a53-d01da6708731\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " Jun 11 23:39:46.841230 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.841072 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle\") pod \"e19c304d-816b-4dc3-9a53-d01da6708731\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " Jun 11 23:39:46.841230 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.841102 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util\") pod \"e19c304d-816b-4dc3-9a53-d01da6708731\" (UID: \"e19c304d-816b-4dc3-9a53-d01da6708731\") " Jun 11 23:39:46.841476 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.841452 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle" (OuterVolumeSpecName: "bundle") pod "e19c304d-816b-4dc3-9a53-d01da6708731" (UID: "e19c304d-816b-4dc3-9a53-d01da6708731"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:39:46.843105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.843076 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2" (OuterVolumeSpecName: "kube-api-access-9p9p2") pod "e19c304d-816b-4dc3-9a53-d01da6708731" (UID: "e19c304d-816b-4dc3-9a53-d01da6708731"). InnerVolumeSpecName "kube-api-access-9p9p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:39:46.845718 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.845687 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util" (OuterVolumeSpecName: "util") pod "e19c304d-816b-4dc3-9a53-d01da6708731" (UID: "e19c304d-816b-4dc3-9a53-d01da6708731"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:39:46.941762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.941729 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p9p2\" (UniqueName: \"kubernetes.io/projected/e19c304d-816b-4dc3-9a53-d01da6708731-kube-api-access-9p9p2\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:46.941762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.941758 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:46.941762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:46.941768 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e19c304d-816b-4dc3-9a53-d01da6708731-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:39:47.646955 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:47.646921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" event={"ID":"e19c304d-816b-4dc3-9a53-d01da6708731","Type":"ContainerDied","Data":"a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152"} Jun 11 23:39:47.647147 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:47.646967 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpmwvc" Jun 11 23:39:47.647147 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:47.646970 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4edd677eb212262fcbab907062d9c0673a9e21a0f2ca9b8d910726c9c660152" Jun 11 23:39:51.867093 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867054 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sz7c"] Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867358 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="util" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867369 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="util" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867383 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="extract" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867388 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="extract" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867403 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="pull" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867408 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="pull" Jun 11 23:39:51.867472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.867465 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e19c304d-816b-4dc3-9a53-d01da6708731" containerName="extract" Jun 11 23:39:51.870628 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.870609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.873218 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.873185 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 23:39:51.873382 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.873250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x2zng\"" Jun 11 23:39:51.874082 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.874067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 23:39:51.877404 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.877375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sz7c"] Jun 11 23:39:51.882976 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.882950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4b8g\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-kube-api-access-w4b8g\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.883144 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.883012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-bound-sa-token\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.983736 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.983698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4b8g\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-kube-api-access-w4b8g\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.983913 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.983745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-bound-sa-token\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.992184 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.992137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-bound-sa-token\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:51.992394 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:51.992373 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4b8g\" (UniqueName: \"kubernetes.io/projected/6606c4c5-c1b9-4f40-9624-6de1b1bd93f2-kube-api-access-w4b8g\") pod \"cert-manager-59c77684cc-2sz7c\" (UID: \"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2\") " pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:52.191756 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:52.191713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2sz7c" Jun 11 23:39:52.328392 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:52.328365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2sz7c"] Jun 11 23:39:52.330952 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:39:52.330926 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6606c4c5_c1b9_4f40_9624_6de1b1bd93f2.slice/crio-ebd0fadc11570aa00ed3228d1553c5415222d863da44c92088c91bff7be4d927 WatchSource:0}: Error finding container ebd0fadc11570aa00ed3228d1553c5415222d863da44c92088c91bff7be4d927: Status 404 returned error can't find the container with id ebd0fadc11570aa00ed3228d1553c5415222d863da44c92088c91bff7be4d927 Jun 11 23:39:52.672110 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:52.672066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2sz7c" event={"ID":"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2","Type":"ContainerStarted","Data":"ebd0fadc11570aa00ed3228d1553c5415222d863da44c92088c91bff7be4d927"} Jun 11 23:39:53.967904 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.967864 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d"] Jun 11 23:39:53.971605 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.971578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:53.975623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.975597 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 23:39:53.975865 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.975597 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 23:39:53.975865 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.975608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h6g8t\"" Jun 11 23:39:53.984964 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:53.984906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d"] Jun 11 23:39:54.001724 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.001665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a741f366-f2e1-4db2-a113-aaf23f4799eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.001724 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.001719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9wt\" (UniqueName: \"kubernetes.io/projected/a741f366-f2e1-4db2-a113-aaf23f4799eb-kube-api-access-rm9wt\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.102747 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.102707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a741f366-f2e1-4db2-a113-aaf23f4799eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.102747 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.102754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9wt\" (UniqueName: \"kubernetes.io/projected/a741f366-f2e1-4db2-a113-aaf23f4799eb-kube-api-access-rm9wt\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.103244 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.103216 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a741f366-f2e1-4db2-a113-aaf23f4799eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.113178 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.113137 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9wt\" (UniqueName: \"kubernetes.io/projected/a741f366-f2e1-4db2-a113-aaf23f4799eb-kube-api-access-rm9wt\") pod \"openshift-lws-operator-fd8ccff4c-qnz7d\" (UID: \"a741f366-f2e1-4db2-a113-aaf23f4799eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:54.285544 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:54.285443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" Jun 11 23:39:55.007279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:55.007251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d"] Jun 11 23:39:55.010571 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:39:55.010541 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda741f366_f2e1_4db2_a113_aaf23f4799eb.slice/crio-51ae32b060dbffe5fb5a9d9c9d48027bee2aa4305c0ddefbecd8c1e88ddbdd88 WatchSource:0}: Error finding container 51ae32b060dbffe5fb5a9d9c9d48027bee2aa4305c0ddefbecd8c1e88ddbdd88: Status 404 returned error can't find the container with id 51ae32b060dbffe5fb5a9d9c9d48027bee2aa4305c0ddefbecd8c1e88ddbdd88 Jun 11 23:39:55.688079 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:55.688036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" event={"ID":"a741f366-f2e1-4db2-a113-aaf23f4799eb","Type":"ContainerStarted","Data":"51ae32b060dbffe5fb5a9d9c9d48027bee2aa4305c0ddefbecd8c1e88ddbdd88"} Jun 11 23:39:55.689502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:55.689477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2sz7c" event={"ID":"6606c4c5-c1b9-4f40-9624-6de1b1bd93f2","Type":"ContainerStarted","Data":"89cf7676e958ccd18a6774b3cf95c12ff60f724ee736209c32173ac743c01cd3"} Jun 11 23:39:55.728710 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:55.728641 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2sz7c" podStartSLOduration=2.1166431 podStartE2EDuration="4.728622451s" totalImagesPullingTime="2.611979351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:55.726333803 +0000 UTC m=+450.244500236" watchObservedRunningTime="2026-06-11 23:39:55.728622451 +0000 UTC m=+450.246788879" Jun 11 23:39:58.704762 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:58.704727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" event={"ID":"a741f366-f2e1-4db2-a113-aaf23f4799eb","Type":"ContainerStarted","Data":"380b13cb85e281b07bb6d1c397f4273eac55dc153bb2b1da2562c12b00b449be"} Jun 11 23:39:58.721658 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:39:58.721601 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qnz7d" podStartSLOduration=2.806465066 podStartE2EDuration="5.721582254s" totalImagesPullingTime="2.915117188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:58.719243118 +0000 UTC m=+453.237409546" watchObservedRunningTime="2026-06-11 23:39:58.721582254 +0000 UTC m=+453.239748682" Jun 11 23:40:01.029581 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.029544 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l"] Jun 11 23:40:01.037182 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.037143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.039543 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.039513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:40:01.039699 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.039615 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:40:01.039761 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.039700 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:40:01.040652 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.040620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l"] Jun 11 23:40:01.060217 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.060187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.060415 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.060227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hmrk\" (UniqueName: \"kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.060415 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.060277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.160789 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.160754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.160960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.160798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hmrk\" (UniqueName: \"kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.160960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.160852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.161270 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.161247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.161314 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.161253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.169460 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.169419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hmrk\" (UniqueName: \"kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.347826 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.347737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:01.483732 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.483704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l"] Jun 11 23:40:01.486940 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:01.486906 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf128f63a_178e_40aa_8b06_2e2aba390479.slice/crio-8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c WatchSource:0}: Error finding container 8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c: Status 404 returned error can't find the container with id 8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c Jun 11 23:40:01.719480 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.719441 2581 generic.go:356] "Generic (PLEG): container finished" podID="f128f63a-178e-40aa-8b06-2e2aba390479" containerID="9e841e2ee34d494c0cb15fb46e054093c91a4bf1ed509677f4cf6c395ebd5b39" exitCode=0 Jun 11 23:40:01.719681 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.719528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" event={"ID":"f128f63a-178e-40aa-8b06-2e2aba390479","Type":"ContainerDied","Data":"9e841e2ee34d494c0cb15fb46e054093c91a4bf1ed509677f4cf6c395ebd5b39"} Jun 11 23:40:01.719681 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:01.719579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" event={"ID":"f128f63a-178e-40aa-8b06-2e2aba390479","Type":"ContainerStarted","Data":"8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c"} Jun 11 23:40:02.725723 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:02.725630 2581 generic.go:356] "Generic (PLEG): container finished" podID="f128f63a-178e-40aa-8b06-2e2aba390479" containerID="761241fb081060a87bcd847e61e89188df493a336246067b79ccf4b8fdfb9f8e" exitCode=0 Jun 11 23:40:02.726111 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:02.725726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" event={"ID":"f128f63a-178e-40aa-8b06-2e2aba390479","Type":"ContainerDied","Data":"761241fb081060a87bcd847e61e89188df493a336246067b79ccf4b8fdfb9f8e"} Jun 11 23:40:03.733333 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:03.733299 2581 generic.go:356] "Generic (PLEG): container finished" podID="f128f63a-178e-40aa-8b06-2e2aba390479" containerID="3c2929fb38f54a0d40295713f920b25ad453713c05e296d81809ba6dd43904ed" exitCode=0 Jun 11 23:40:03.733821 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:03.733338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" event={"ID":"f128f63a-178e-40aa-8b06-2e2aba390479","Type":"ContainerDied","Data":"3c2929fb38f54a0d40295713f920b25ad453713c05e296d81809ba6dd43904ed"} Jun 11 23:40:04.870059 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.870024 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:04.993390 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.993285 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util\") pod \"f128f63a-178e-40aa-8b06-2e2aba390479\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " Jun 11 23:40:04.993390 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.993351 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hmrk\" (UniqueName: \"kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk\") pod \"f128f63a-178e-40aa-8b06-2e2aba390479\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " Jun 11 23:40:04.993612 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.993431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle\") pod \"f128f63a-178e-40aa-8b06-2e2aba390479\" (UID: \"f128f63a-178e-40aa-8b06-2e2aba390479\") " Jun 11 23:40:04.994177 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.994138 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle" (OuterVolumeSpecName: "bundle") pod "f128f63a-178e-40aa-8b06-2e2aba390479" (UID: "f128f63a-178e-40aa-8b06-2e2aba390479"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:04.995596 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.995569 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk" (OuterVolumeSpecName: "kube-api-access-7hmrk") pod "f128f63a-178e-40aa-8b06-2e2aba390479" (UID: "f128f63a-178e-40aa-8b06-2e2aba390479"). InnerVolumeSpecName "kube-api-access-7hmrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:40:04.998783 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:04.998749 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util" (OuterVolumeSpecName: "util") pod "f128f63a-178e-40aa-8b06-2e2aba390479" (UID: "f128f63a-178e-40aa-8b06-2e2aba390479"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:05.094191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.094152 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:05.094191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.094187 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f128f63a-178e-40aa-8b06-2e2aba390479-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:05.094191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.094195 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hmrk\" (UniqueName: \"kubernetes.io/projected/f128f63a-178e-40aa-8b06-2e2aba390479-kube-api-access-7hmrk\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:05.750543 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.750516 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" Jun 11 23:40:05.750706 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.750546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwrb4l" event={"ID":"f128f63a-178e-40aa-8b06-2e2aba390479","Type":"ContainerDied","Data":"8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c"} Jun 11 23:40:05.750706 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:05.750625 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cb44790d748cf0bb1117940cdb21c73ba61b87956aedbdca8d09344b8c1161c" Jun 11 23:40:14.982642 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982614 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2"] Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982893 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="extract" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982908 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="extract" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982923 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="pull" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982929 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="pull" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982952 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="util" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.982959 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="util" Jun 11 23:40:14.983189 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.983034 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f128f63a-178e-40aa-8b06-2e2aba390479" containerName="extract" Jun 11 23:40:14.991657 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.991633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:14.994065 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.994043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 23:40:14.994065 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.994055 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 23:40:14.994240 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.994067 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wwdx\"" Jun 11 23:40:14.994240 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.994134 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 23:40:14.994240 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:14.994060 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 23:40:15.003053 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.003029 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2"] Jun 11 23:40:15.083036 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.082982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.083187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.083044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmnb\" (UniqueName: \"kubernetes.io/projected/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-kube-api-access-2hmnb\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.083187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.083095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.083187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.083127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.083187 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.083153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.184693 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.184656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.184855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.184711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmnb\" (UniqueName: \"kubernetes.io/projected/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-kube-api-access-2hmnb\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.184855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.184746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.184855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.184778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.184855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.184805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.185237 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.185209 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-manifests\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.186956 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.186935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-tmp\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.187229 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.187204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-webhook-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.187295 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.187265 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.192936 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.192914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmnb\" (UniqueName: \"kubernetes.io/projected/3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234-kube-api-access-2hmnb\") pod \"opendatahub-operator-controller-manager-585bb5b6dc-rv4w2\" (UID: \"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234\") " pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.302562 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.302482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:15.439186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.439159 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2"] Jun 11 23:40:15.441008 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:15.440970 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de6c973_f7c8_4d3e_9c47_2c3a2e7fc234.slice/crio-f31e166a0dc0d4939d6998686890f47f9fb0bef0e73d05bdc62f7162e87eb869 WatchSource:0}: Error finding container f31e166a0dc0d4939d6998686890f47f9fb0bef0e73d05bdc62f7162e87eb869: Status 404 returned error can't find the container with id f31e166a0dc0d4939d6998686890f47f9fb0bef0e73d05bdc62f7162e87eb869 Jun 11 23:40:15.795543 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:15.795508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" event={"ID":"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234","Type":"ContainerStarted","Data":"f31e166a0dc0d4939d6998686890f47f9fb0bef0e73d05bdc62f7162e87eb869"} Jun 11 23:40:18.813515 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:18.813476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" event={"ID":"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234","Type":"ContainerStarted","Data":"b43d34c2fed5ab100e8416180f3076d854c7a463135f9ab37bedb322b1866d8f"} Jun 11 23:40:19.819269 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:19.819236 2581 generic.go:356] "Generic (PLEG): container finished" podID="3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234" containerID="b43d34c2fed5ab100e8416180f3076d854c7a463135f9ab37bedb322b1866d8f" exitCode=0 Jun 11 23:40:19.819716 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:19.819297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" event={"ID":"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234","Type":"ContainerDied","Data":"b43d34c2fed5ab100e8416180f3076d854c7a463135f9ab37bedb322b1866d8f"} Jun 11 23:40:20.825738 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:20.825703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" event={"ID":"3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234","Type":"ContainerStarted","Data":"191f54aaad786151f5b39dde116628c2502f86577b9715d5549ccdc48e1bcb18"} Jun 11 23:40:20.826132 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:20.825842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:20.848685 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:20.848627 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" podStartSLOduration=2.674601726 podStartE2EDuration="6.848607838s" totalImagesPullingTime="3.203579923s" totalInitContainerRuntime="970.426189ms" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:20.845300969 +0000 UTC m=+475.363467397" watchObservedRunningTime="2026-06-11 23:40:20.848607838 +0000 UTC m=+475.366774268" Jun 11 23:40:31.833672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:31.833642 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-585bb5b6dc-rv4w2" Jun 11 23:40:35.402377 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.402339 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb"] Jun 11 23:40:35.412101 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.412075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.414735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.414712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 23:40:35.415183 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.415162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 23:40:35.422591 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.422565 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb"] Jun 11 23:40:35.557026 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.556975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7eb992-d843-431d-b387-4ed0210714a4-tmp\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.557026 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.557029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89z5f\" (UniqueName: \"kubernetes.io/projected/ba7eb992-d843-431d-b387-4ed0210714a4-kube-api-access-89z5f\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.557214 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.557072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba7eb992-d843-431d-b387-4ed0210714a4-tls-certs\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.585524 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.585494 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c5h67"] Jun 11 23:40:35.590365 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.590345 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.595115 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.595089 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 23:40:35.595368 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.595346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lhqr6\"" Jun 11 23:40:35.597647 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.597623 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c5h67"] Jun 11 23:40:35.657886 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.657781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba7eb992-d843-431d-b387-4ed0210714a4-tls-certs\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.657886 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.657867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7eb992-d843-431d-b387-4ed0210714a4-tmp\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.658130 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.657896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89z5f\" (UniqueName: \"kubernetes.io/projected/ba7eb992-d843-431d-b387-4ed0210714a4-kube-api-access-89z5f\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.660218 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.660190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba7eb992-d843-431d-b387-4ed0210714a4-tmp\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.660492 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.660470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba7eb992-d843-431d-b387-4ed0210714a4-tls-certs\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.669036 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.668981 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89z5f\" (UniqueName: \"kubernetes.io/projected/ba7eb992-d843-431d-b387-4ed0210714a4-kube-api-access-89z5f\") pod \"kube-auth-proxy-78ddc77f7c-fpkjb\" (UID: \"ba7eb992-d843-431d-b387-4ed0210714a4\") " pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.724350 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.724327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" Jun 11 23:40:35.758472 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.758424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphn2\" (UniqueName: \"kubernetes.io/projected/78ea3dee-2ae6-497b-a021-885cad89217b-kube-api-access-vphn2\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.758624 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.758494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.859142 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.859102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.859327 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.859265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vphn2\" (UniqueName: \"kubernetes.io/projected/78ea3dee-2ae6-497b-a021-885cad89217b-kube-api-access-vphn2\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.859327 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:40:35.859276 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 23:40:35.859454 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:40:35.859350 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert podName:78ea3dee-2ae6-497b-a021-885cad89217b nodeName:}" failed. No retries permitted until 2026-06-11 23:40:36.359328949 +0000 UTC m=+490.877495359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert") pod "odh-model-controller-6dc94f689f-c5h67" (UID: "78ea3dee-2ae6-497b-a021-885cad89217b") : secret "odh-model-controller-webhook-cert" not found Jun 11 23:40:35.870421 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.870387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphn2\" (UniqueName: \"kubernetes.io/projected/78ea3dee-2ae6-497b-a021-885cad89217b-kube-api-access-vphn2\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:35.888117 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.888090 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb"] Jun 11 23:40:35.890216 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:35.890194 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7eb992_d843_431d_b387_4ed0210714a4.slice/crio-6b27644d27ffce12b0d53fd45542d14bae2b2e77f3692cf3eb232dd1b2676035 WatchSource:0}: Error finding container 6b27644d27ffce12b0d53fd45542d14bae2b2e77f3692cf3eb232dd1b2676035: Status 404 returned error can't find the container with id 6b27644d27ffce12b0d53fd45542d14bae2b2e77f3692cf3eb232dd1b2676035 Jun 11 23:40:35.898895 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:35.898870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" event={"ID":"ba7eb992-d843-431d-b387-4ed0210714a4","Type":"ContainerStarted","Data":"6b27644d27ffce12b0d53fd45542d14bae2b2e77f3692cf3eb232dd1b2676035"} Jun 11 23:40:36.348299 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.348265 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hv9x5"] Jun 11 23:40:36.353097 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.353078 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.361105 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.361083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 23:40:36.362447 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.362421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:36.364782 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.364762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78ea3dee-2ae6-497b-a021-885cad89217b-cert\") pod \"odh-model-controller-6dc94f689f-c5h67\" (UID: \"78ea3dee-2ae6-497b-a021-885cad89217b\") " pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:36.382649 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.382625 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hv9x5"] Jun 11 23:40:36.463144 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.463116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-tls-certs\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.463461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.463173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nch8j\" (UniqueName: \"kubernetes.io/projected/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-kube-api-access-nch8j\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.502981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.502956 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:36.565617 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.564453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-tls-certs\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.565617 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.564551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nch8j\" (UniqueName: \"kubernetes.io/projected/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-kube-api-access-nch8j\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.569539 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.569480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-tls-certs\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.579151 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.579121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nch8j\" (UniqueName: \"kubernetes.io/projected/2e7a03af-1c0b-4317-b8d2-b538e2c53f26-kube-api-access-nch8j\") pod \"model-serving-api-5dd488fc48-hv9x5\" (UID: \"2e7a03af-1c0b-4317-b8d2-b538e2c53f26\") " pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.665031 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.664887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:36.669313 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.668880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c5h67"] Jun 11 23:40:36.840569 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.840542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hv9x5"] Jun 11 23:40:36.842721 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:36.842676 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7a03af_1c0b_4317_b8d2_b538e2c53f26.slice/crio-934597c011982ec6e54ec32af93e0c180d222a0f487c3cb11faf68e87b7f1fa4 WatchSource:0}: Error finding container 934597c011982ec6e54ec32af93e0c180d222a0f487c3cb11faf68e87b7f1fa4: Status 404 returned error can't find the container with id 934597c011982ec6e54ec32af93e0c180d222a0f487c3cb11faf68e87b7f1fa4 Jun 11 23:40:36.907950 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.907869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" event={"ID":"78ea3dee-2ae6-497b-a021-885cad89217b","Type":"ContainerStarted","Data":"45e10c9b162e4d02089953f85afce90d4610e33decee819e616a3d6c2f4b7013"} Jun 11 23:40:36.909757 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:36.909722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" event={"ID":"2e7a03af-1c0b-4317-b8d2-b538e2c53f26","Type":"ContainerStarted","Data":"934597c011982ec6e54ec32af93e0c180d222a0f487c3cb11faf68e87b7f1fa4"} Jun 11 23:40:39.457698 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.457663 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586"] Jun 11 23:40:39.463279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.463257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.466130 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.466013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:40:39.466130 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.466093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:40:39.466357 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.466134 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:40:39.470807 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.470613 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586"] Jun 11 23:40:39.593954 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.593882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcj47\" (UniqueName: \"kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.593954 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.593955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.594211 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.594119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.695184 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.695150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcj47\" (UniqueName: \"kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.695358 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.695204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.695358 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.695269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.695635 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.695618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.695706 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.695659 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.704090 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.704065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcj47\" (UniqueName: \"kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:39.779267 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:39.779191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:41.422904 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.422879 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586"] Jun 11 23:40:41.425017 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:41.424977 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a7e74b_52c6_415b_abe4_c55ed3581a93.slice/crio-b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91 WatchSource:0}: Error finding container b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91: Status 404 returned error can't find the container with id b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91 Jun 11 23:40:41.946156 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.946119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" event={"ID":"ba7eb992-d843-431d-b387-4ed0210714a4","Type":"ContainerStarted","Data":"5ba27c4b6b6ffd6b4c7c99bdd559425ab84267db99dff02aebf52209759a81ab"} Jun 11 23:40:41.948460 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.948426 2581 generic.go:356] "Generic (PLEG): container finished" podID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerID="b6a2d1e3383dbe43a568694a5121063ac0ddcd838126c847943a8b16a3fbc68c" exitCode=0 Jun 11 23:40:41.948611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.948472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" event={"ID":"19a7e74b-52c6-415b-abe4-c55ed3581a93","Type":"ContainerDied","Data":"b6a2d1e3383dbe43a568694a5121063ac0ddcd838126c847943a8b16a3fbc68c"} Jun 11 23:40:41.948611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.948522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" event={"ID":"19a7e74b-52c6-415b-abe4-c55ed3581a93","Type":"ContainerStarted","Data":"b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91"} Jun 11 23:40:41.950604 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.950509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" event={"ID":"78ea3dee-2ae6-497b-a021-885cad89217b","Type":"ContainerStarted","Data":"2a24c3964ea7a091b13bcf265552f8d084e9aa70d66591ae058b6a89f0638837"} Jun 11 23:40:41.950604 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.950597 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:41.952252 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.952227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" event={"ID":"2e7a03af-1c0b-4317-b8d2-b538e2c53f26","Type":"ContainerStarted","Data":"ea19d1e1939397bf4e2e03b9ad35cd6a98c07b660cf5482bc2c9981ce2c50cea"} Jun 11 23:40:41.952380 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.952365 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:41.964349 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.964298 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78ddc77f7c-fpkjb" podStartSLOduration=1.59342776 podStartE2EDuration="6.96427956s" totalImagesPullingTime="5.3708518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:41.961483423 +0000 UTC m=+496.479649852" watchObservedRunningTime="2026-06-11 23:40:41.96427956 +0000 UTC m=+496.482445989" Jun 11 23:40:41.977742 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.977690 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" podStartSLOduration=2.376309716 podStartE2EDuration="6.97767206s" totalImagesPullingTime="4.601362344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:41.976404321 +0000 UTC m=+496.494570750" watchObservedRunningTime="2026-06-11 23:40:41.97767206 +0000 UTC m=+496.495838490" Jun 11 23:40:41.992966 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:41.992923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" podStartSLOduration=1.574873823 podStartE2EDuration="5.99290898s" totalImagesPullingTime="4.418035157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:41.992131357 +0000 UTC m=+496.510297802" watchObservedRunningTime="2026-06-11 23:40:41.99290898 +0000 UTC m=+496.511075408" Jun 11 23:40:42.961900 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:42.961868 2581 generic.go:356] "Generic (PLEG): container finished" podID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerID="9cfb0ba296641f8cd96b397e9d0cd6a95ebacbb0d85c66421103b77900b43628" exitCode=0 Jun 11 23:40:42.962354 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:42.961972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" event={"ID":"19a7e74b-52c6-415b-abe4-c55ed3581a93","Type":"ContainerDied","Data":"9cfb0ba296641f8cd96b397e9d0cd6a95ebacbb0d85c66421103b77900b43628"} Jun 11 23:40:43.968422 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:43.968384 2581 generic.go:356] "Generic (PLEG): container finished" podID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerID="f0c01bcfe6368ba41d6f852323f5aca662b84f4b4212122d568024e46bf7f926" exitCode=0 Jun 11 23:40:43.968774 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:43.968452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" event={"ID":"19a7e74b-52c6-415b-abe4-c55ed3581a93","Type":"ContainerDied","Data":"f0c01bcfe6368ba41d6f852323f5aca662b84f4b4212122d568024e46bf7f926"} Jun 11 23:40:45.096090 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.096061 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:45.142960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.142936 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcj47\" (UniqueName: \"kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47\") pod \"19a7e74b-52c6-415b-abe4-c55ed3581a93\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " Jun 11 23:40:45.143087 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.142965 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle\") pod \"19a7e74b-52c6-415b-abe4-c55ed3581a93\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " Jun 11 23:40:45.143087 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.143006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util\") pod \"19a7e74b-52c6-415b-abe4-c55ed3581a93\" (UID: \"19a7e74b-52c6-415b-abe4-c55ed3581a93\") " Jun 11 23:40:45.143802 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.143775 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle" (OuterVolumeSpecName: "bundle") pod "19a7e74b-52c6-415b-abe4-c55ed3581a93" (UID: "19a7e74b-52c6-415b-abe4-c55ed3581a93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:45.144956 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.144932 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47" (OuterVolumeSpecName: "kube-api-access-zcj47") pod "19a7e74b-52c6-415b-abe4-c55ed3581a93" (UID: "19a7e74b-52c6-415b-abe4-c55ed3581a93"). InnerVolumeSpecName "kube-api-access-zcj47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:40:45.149773 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.149748 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util" (OuterVolumeSpecName: "util") pod "19a7e74b-52c6-415b-abe4-c55ed3581a93" (UID: "19a7e74b-52c6-415b-abe4-c55ed3581a93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:45.244489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.244418 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcj47\" (UniqueName: \"kubernetes.io/projected/19a7e74b-52c6-415b-abe4-c55ed3581a93-kube-api-access-zcj47\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:45.244489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.244444 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:45.244489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.244453 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a7e74b-52c6-415b-abe4-c55ed3581a93-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:45.980925 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.980896 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" Jun 11 23:40:45.983659 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.983627 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sm586" event={"ID":"19a7e74b-52c6-415b-abe4-c55ed3581a93","Type":"ContainerDied","Data":"b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91"} Jun 11 23:40:45.983780 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:45.983680 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1cfe519d34e9032239b161e5a366e32c122f263043b32b05342d5fd2e30fe91" Jun 11 23:40:46.150694 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.150654 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rhvw4"] Jun 11 23:40:46.151196 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151176 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="pull" Jun 11 23:40:46.151266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151205 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="pull" Jun 11 23:40:46.151266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151223 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="util" Jun 11 23:40:46.151266 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151231 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="util" Jun 11 23:40:46.151406 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151269 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="extract" Jun 11 23:40:46.151406 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151278 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="extract" Jun 11 23:40:46.151406 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.151366 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a7e74b-52c6-415b-abe4-c55ed3581a93" containerName="extract" Jun 11 23:40:46.155474 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.155450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.155726 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.155699 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r"] Jun 11 23:40:46.158556 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.158507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p4wph\"" Jun 11 23:40:46.158556 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.158540 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 23:40:46.159356 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.159336 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rhvw4"] Jun 11 23:40:46.159471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.159410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.162023 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.162003 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dw8jz\"" Jun 11 23:40:46.162123 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.162006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 23:40:46.173633 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.173614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r"] Jun 11 23:40:46.253940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.253865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n7gm\" (UniqueName: \"kubernetes.io/projected/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-kube-api-access-6n7gm\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.253940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.253913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbq7\" (UniqueName: \"kubernetes.io/projected/b4e98126-9d90-4a3a-9279-6a0373290ed5-kube-api-access-qwbq7\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.254113 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.253950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.254113 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.253975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4e98126-9d90-4a3a-9279-6a0373290ed5-cert\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.355267 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.355239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbq7\" (UniqueName: \"kubernetes.io/projected/b4e98126-9d90-4a3a-9279-6a0373290ed5-kube-api-access-qwbq7\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.355409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.355277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.355409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.355308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4e98126-9d90-4a3a-9279-6a0373290ed5-cert\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.355409 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.355381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n7gm\" (UniqueName: \"kubernetes.io/projected/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-kube-api-access-6n7gm\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.357861 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.357837 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4e98126-9d90-4a3a-9279-6a0373290ed5-cert\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.357953 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.357873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.374831 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.374802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n7gm\" (UniqueName: \"kubernetes.io/projected/470fd895-f9e8-4544-84b3-9ca47d3ee3ec-kube-api-access-6n7gm\") pod \"llmisvc-controller-manager-864bfd7bc9-c245r\" (UID: \"470fd895-f9e8-4544-84b3-9ca47d3ee3ec\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.375654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.375633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbq7\" (UniqueName: \"kubernetes.io/projected/b4e98126-9d90-4a3a-9279-6a0373290ed5-kube-api-access-qwbq7\") pod \"kserve-controller-manager-69fc866d76-rhvw4\" (UID: \"b4e98126-9d90-4a3a-9279-6a0373290ed5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.469738 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.469712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:46.476798 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.476782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:46.633118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.632772 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rhvw4"] Jun 11 23:40:46.636388 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:46.636345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e98126_9d90_4a3a_9279_6a0373290ed5.slice/crio-272f68c82a269e4cc9f9133a749f2b6014d58cc5367c662588fda4f5de54503e WatchSource:0}: Error finding container 272f68c82a269e4cc9f9133a749f2b6014d58cc5367c662588fda4f5de54503e: Status 404 returned error can't find the container with id 272f68c82a269e4cc9f9133a749f2b6014d58cc5367c662588fda4f5de54503e Jun 11 23:40:46.664058 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.664034 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r"] Jun 11 23:40:46.666804 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:46.666776 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod470fd895_f9e8_4544_84b3_9ca47d3ee3ec.slice/crio-d8e02f16ed3aa17aa29c4932fc69cc93f74484b6a07bce8ec063d59b6c859345 WatchSource:0}: Error finding container d8e02f16ed3aa17aa29c4932fc69cc93f74484b6a07bce8ec063d59b6c859345: Status 404 returned error can't find the container with id d8e02f16ed3aa17aa29c4932fc69cc93f74484b6a07bce8ec063d59b6c859345 Jun 11 23:40:46.986955 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.986923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" event={"ID":"470fd895-f9e8-4544-84b3-9ca47d3ee3ec","Type":"ContainerStarted","Data":"d8e02f16ed3aa17aa29c4932fc69cc93f74484b6a07bce8ec063d59b6c859345"} Jun 11 23:40:46.988047 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:46.988021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" event={"ID":"b4e98126-9d90-4a3a-9279-6a0373290ed5","Type":"ContainerStarted","Data":"272f68c82a269e4cc9f9133a749f2b6014d58cc5367c662588fda4f5de54503e"} Jun 11 23:40:50.004285 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.004254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" event={"ID":"470fd895-f9e8-4544-84b3-9ca47d3ee3ec","Type":"ContainerStarted","Data":"e4d22fb8be4a8aa9f3217e41b2a7f2133af0a29880ee172992d45d91189f8e76"} Jun 11 23:40:50.004719 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.004328 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:40:50.005856 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.005822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" event={"ID":"b4e98126-9d90-4a3a-9279-6a0373290ed5","Type":"ContainerStarted","Data":"8fef4c2488f1f0c34a4b9679d9b75542f72b26241f0f8df6a1d34ef7272e66b4"} Jun 11 23:40:50.005960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.005949 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:40:50.020945 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.020861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" podStartSLOduration=0.823798341 podStartE2EDuration="4.020842202s" totalImagesPullingTime="3.197043861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:50.018391111 +0000 UTC m=+504.536557568" watchObservedRunningTime="2026-06-11 23:40:50.020842202 +0000 UTC m=+504.539008631" Jun 11 23:40:50.034330 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:50.034289 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" podStartSLOduration=1.42190106 podStartE2EDuration="4.034275467s" totalImagesPullingTime="2.612374407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:50.032210353 +0000 UTC m=+504.550376781" watchObservedRunningTime="2026-06-11 23:40:50.034275467 +0000 UTC m=+504.552441896" Jun 11 23:40:52.964936 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:52.964903 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-c5h67" Jun 11 23:40:52.967769 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:52.967749 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hv9x5" Jun 11 23:40:54.429259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.429220 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n"] Jun 11 23:40:54.438851 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.438828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.443678 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.443656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:40:54.443819 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.443657 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:40:54.445478 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.445179 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:40:54.458981 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.458953 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n"] Jun 11 23:40:54.530190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.530158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.530190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.530192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.530390 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.530209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5pp4\" (UniqueName: \"kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.630970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.630937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.630970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.630970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.631185 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.630988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5pp4\" (UniqueName: \"kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.631341 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.631322 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.631408 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.631380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.641197 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.641168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5pp4\" (UniqueName: \"kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.752504 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.752426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:54.893373 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:54.893349 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n"] Jun 11 23:40:54.895867 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:54.895841 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cb7362_18b1_4361_8e95_63e80ab4f003.slice/crio-4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0 WatchSource:0}: Error finding container 4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0: Status 404 returned error can't find the container with id 4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0 Jun 11 23:40:55.034654 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:55.034620 2581 generic.go:356] "Generic (PLEG): container finished" podID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerID="59475e267d8e5ca4aa3f70df16304c3fc11d4167f6f96f267ac9bfa5b1185b84" exitCode=0 Jun 11 23:40:55.034790 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:55.034655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" event={"ID":"24cb7362-18b1-4361-8e95-63e80ab4f003","Type":"ContainerDied","Data":"59475e267d8e5ca4aa3f70df16304c3fc11d4167f6f96f267ac9bfa5b1185b84"} Jun 11 23:40:55.034790 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:55.034703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" event={"ID":"24cb7362-18b1-4361-8e95-63e80ab4f003","Type":"ContainerStarted","Data":"4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0"} Jun 11 23:40:56.020327 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.020299 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4"] Jun 11 23:40:56.023622 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.023607 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.026182 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.026165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4r42v\"" Jun 11 23:40:56.026542 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.026525 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 23:40:56.026637 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.026540 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 23:40:56.041678 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.041650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4"] Jun 11 23:40:56.044300 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.044271 2581 generic.go:356] "Generic (PLEG): container finished" podID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerID="53e1651bf92e2be54b9a1bae5efbc5c7432b796e21607d66de6249dc841e3a99" exitCode=0 Jun 11 23:40:56.044418 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.044330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" event={"ID":"24cb7362-18b1-4361-8e95-63e80ab4f003","Type":"ContainerDied","Data":"53e1651bf92e2be54b9a1bae5efbc5c7432b796e21607d66de6249dc841e3a99"} Jun 11 23:40:56.143355 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.143329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/80688a7e-114d-4cac-8e61-d3d4fcab4c65-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.143489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.143368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9vl\" (UniqueName: \"kubernetes.io/projected/80688a7e-114d-4cac-8e61-d3d4fcab4c65-kube-api-access-xj9vl\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.244988 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.244935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/80688a7e-114d-4cac-8e61-d3d4fcab4c65-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.245159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.245029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9vl\" (UniqueName: \"kubernetes.io/projected/80688a7e-114d-4cac-8e61-d3d4fcab4c65-kube-api-access-xj9vl\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.247766 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.247743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/80688a7e-114d-4cac-8e61-d3d4fcab4c65-operator-config\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.259595 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.259571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9vl\" (UniqueName: \"kubernetes.io/projected/80688a7e-114d-4cac-8e61-d3d4fcab4c65-kube-api-access-xj9vl\") pod \"servicemesh-operator3-57f65f65fb-m2dq4\" (UID: \"80688a7e-114d-4cac-8e61-d3d4fcab4c65\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.334413 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.334342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:40:56.474482 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:56.474453 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4"] Jun 11 23:40:56.476180 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:40:56.476153 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80688a7e_114d_4cac_8e61_d3d4fcab4c65.slice/crio-f9868834581a105fd7f539fda827d3f7cfff68431e322f65859750f2adfe058a WatchSource:0}: Error finding container f9868834581a105fd7f539fda827d3f7cfff68431e322f65859750f2adfe058a: Status 404 returned error can't find the container with id f9868834581a105fd7f539fda827d3f7cfff68431e322f65859750f2adfe058a Jun 11 23:40:57.051416 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:57.051378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" event={"ID":"80688a7e-114d-4cac-8e61-d3d4fcab4c65","Type":"ContainerStarted","Data":"f9868834581a105fd7f539fda827d3f7cfff68431e322f65859750f2adfe058a"} Jun 11 23:40:57.053594 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:57.053568 2581 generic.go:356] "Generic (PLEG): container finished" podID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerID="6bba026bad7399c9bf288cc12bc82549fd0e77dab05ca4e3e47752667ab3c56a" exitCode=0 Jun 11 23:40:57.053725 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:57.053647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" event={"ID":"24cb7362-18b1-4361-8e95-63e80ab4f003","Type":"ContainerDied","Data":"6bba026bad7399c9bf288cc12bc82549fd0e77dab05ca4e3e47752667ab3c56a"} Jun 11 23:40:59.125711 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.125682 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:40:59.174444 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.174421 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util\") pod \"24cb7362-18b1-4361-8e95-63e80ab4f003\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " Jun 11 23:40:59.174536 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.174481 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle\") pod \"24cb7362-18b1-4361-8e95-63e80ab4f003\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " Jun 11 23:40:59.174536 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.174528 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5pp4\" (UniqueName: \"kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4\") pod \"24cb7362-18b1-4361-8e95-63e80ab4f003\" (UID: \"24cb7362-18b1-4361-8e95-63e80ab4f003\") " Jun 11 23:40:59.175462 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.175431 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle" (OuterVolumeSpecName: "bundle") pod "24cb7362-18b1-4361-8e95-63e80ab4f003" (UID: "24cb7362-18b1-4361-8e95-63e80ab4f003"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:59.176871 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.176842 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4" (OuterVolumeSpecName: "kube-api-access-n5pp4") pod "24cb7362-18b1-4361-8e95-63e80ab4f003" (UID: "24cb7362-18b1-4361-8e95-63e80ab4f003"). InnerVolumeSpecName "kube-api-access-n5pp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:40:59.180817 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.180788 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util" (OuterVolumeSpecName: "util") pod "24cb7362-18b1-4361-8e95-63e80ab4f003" (UID: "24cb7362-18b1-4361-8e95-63e80ab4f003"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:40:59.276093 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.276063 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:59.276093 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.276088 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24cb7362-18b1-4361-8e95-63e80ab4f003-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:40:59.276093 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:40:59.276098 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5pp4\" (UniqueName: \"kubernetes.io/projected/24cb7362-18b1-4361-8e95-63e80ab4f003-kube-api-access-n5pp4\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:00.075233 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.075196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" event={"ID":"80688a7e-114d-4cac-8e61-d3d4fcab4c65","Type":"ContainerStarted","Data":"edabe1228bb1b892a2f3d64ed1485a0a625f5ea4fe7996d3e03b39209901e22d"} Jun 11 23:41:00.075420 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.075398 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:41:00.077267 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.077238 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" Jun 11 23:41:00.077267 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.077254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at4q7n" event={"ID":"24cb7362-18b1-4361-8e95-63e80ab4f003","Type":"ContainerDied","Data":"4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0"} Jun 11 23:41:00.077408 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.077291 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4069b2919928f4997f8c03bbed1623b98bb1e73c5435fc8eb1b83dd021e473e0" Jun 11 23:41:00.096964 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:00.096911 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" podStartSLOduration=2.405543605 podStartE2EDuration="5.096893048s" totalImagesPullingTime="2.691349443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:00.09451118 +0000 UTC m=+514.612677613" watchObservedRunningTime="2026-06-11 23:41:00.096893048 +0000 UTC m=+514.615059478" Jun 11 23:41:05.540963 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.540927 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw"] Jun 11 23:41:05.541446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541430 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="extract" Jun 11 23:41:05.541501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="extract" Jun 11 23:41:05.541501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541468 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="util" Jun 11 23:41:05.541501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541476 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="util" Jun 11 23:41:05.541501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541488 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="pull" Jun 11 23:41:05.541501 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541496 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="pull" Jun 11 23:41:05.541636 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.541584 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="24cb7362-18b1-4361-8e95-63e80ab4f003" containerName="extract" Jun 11 23:41:05.545113 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.545089 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.548191 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.548161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 23:41:05.548322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.548161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 23:41:05.548322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.548174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 23:41:05.548322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.548178 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 23:41:05.548322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.548268 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8qs4b\"" Jun 11 23:41:05.554781 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.554760 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw"] Jun 11 23:41:05.634066 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfllx\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-kube-api-access-pfllx\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634213 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefba884-fa3d-4d81-a62c-ef19ec9396c6-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634213 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634378 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634422 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.634464 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.634424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735440 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735405 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfllx\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-kube-api-access-pfllx\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefba884-fa3d-4d81-a62c-ef19ec9396c6-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.735623 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.735618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.736300 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.736273 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.738038 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.738012 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.738143 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.738108 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefba884-fa3d-4d81-a62c-ef19ec9396c6-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.738459 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.738432 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.738634 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.738617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cefba884-fa3d-4d81-a62c-ef19ec9396c6-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.743982 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.743953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfllx\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-kube-api-access-pfllx\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.744259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.744238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefba884-fa3d-4d81-a62c-ef19ec9396c6-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-bgttw\" (UID: \"cefba884-fa3d-4d81-a62c-ef19ec9396c6\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:05.857214 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:05.857127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:06.002979 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:06.002950 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw"] Jun 11 23:41:06.004642 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:06.004606 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefba884_fa3d_4d81_a62c_ef19ec9396c6.slice/crio-85849517f91b58ab58e70e00393163d97a6817e8999cb78fc3b09e7656e44bb0 WatchSource:0}: Error finding container 85849517f91b58ab58e70e00393163d97a6817e8999cb78fc3b09e7656e44bb0: Status 404 returned error can't find the container with id 85849517f91b58ab58e70e00393163d97a6817e8999cb78fc3b09e7656e44bb0 Jun 11 23:41:06.108224 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:06.108119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" event={"ID":"cefba884-fa3d-4d81-a62c-ef19ec9396c6","Type":"ContainerStarted","Data":"85849517f91b58ab58e70e00393163d97a6817e8999cb78fc3b09e7656e44bb0"} Jun 11 23:41:08.779333 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:08.779296 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 11 23:41:08.779611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:08.779372 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 11 23:41:09.126563 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:09.126481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" event={"ID":"cefba884-fa3d-4d81-a62c-ef19ec9396c6","Type":"ContainerStarted","Data":"ffdffe407e262c09c4ddb7771535d787101185529b9a8200e5c203c1bf8e90ef"} Jun 11 23:41:09.126716 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:09.126699 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:09.127984 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:09.127961 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-bgttw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 23:41:09.128116 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:09.128023 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" podUID="cefba884-fa3d-4d81-a62c-ef19ec9396c6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 23:41:09.150742 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:09.150702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" podStartSLOduration=1.378292356 podStartE2EDuration="4.15068607s" totalImagesPullingTime="2.772393714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:09.148528594 +0000 UTC m=+523.666695028" watchObservedRunningTime="2026-06-11 23:41:09.15068607 +0000 UTC m=+523.668852499" Jun 11 23:41:10.132612 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.132586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-bgttw" Jun 11 23:41:10.566881 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.566852 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-97p8r"] Jun 11 23:41:10.570470 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.570454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.574425 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.574396 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 23:41:10.574533 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.574396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k2g6m\"" Jun 11 23:41:10.592595 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.592571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-97p8r"] Jun 11 23:41:10.683862 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.683829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lh5f\" (UniqueName: \"kubernetes.io/projected/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-kube-api-access-2lh5f\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.683977 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.683874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.785103 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.785076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lh5f\" (UniqueName: \"kubernetes.io/projected/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-kube-api-access-2lh5f\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.785231 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.785123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.785805 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.785787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-redirect-config\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.797153 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.797132 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lh5f\" (UniqueName: \"kubernetes.io/projected/a04480c8-f5cf-4257-a4b2-a7f12f7588cc-kube-api-access-2lh5f\") pod \"dashboard-redirect-8569bc4bf6-97p8r\" (UID: \"a04480c8-f5cf-4257-a4b2-a7f12f7588cc\") " pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:10.881079 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:10.881019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" Jun 11 23:41:11.083693 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:11.083666 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-m2dq4" Jun 11 23:41:11.223087 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:11.223066 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8569bc4bf6-97p8r"] Jun 11 23:41:11.225764 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:11.225730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04480c8_f5cf_4257_a4b2_a7f12f7588cc.slice/crio-1106b51fff8485769dd9e56307b1dd7209af462aefddbf259931d777e64ccb95 WatchSource:0}: Error finding container 1106b51fff8485769dd9e56307b1dd7209af462aefddbf259931d777e64ccb95: Status 404 returned error can't find the container with id 1106b51fff8485769dd9e56307b1dd7209af462aefddbf259931d777e64ccb95 Jun 11 23:41:12.143707 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:12.143668 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" event={"ID":"a04480c8-f5cf-4257-a4b2-a7f12f7588cc","Type":"ContainerStarted","Data":"1106b51fff8485769dd9e56307b1dd7209af462aefddbf259931d777e64ccb95"} Jun 11 23:41:15.164587 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:15.164554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" event={"ID":"a04480c8-f5cf-4257-a4b2-a7f12f7588cc","Type":"ContainerStarted","Data":"04aa3459f386304da0b87d82a8c9efee99ab1fc3a4db3fbd12fe767fc3274274"} Jun 11 23:41:15.181814 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:15.181766 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8569bc4bf6-97p8r" podStartSLOduration=2.35087666 podStartE2EDuration="5.181748568s" totalImagesPullingTime="2.830871908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:41:15.179573363 +0000 UTC m=+529.697739816" watchObservedRunningTime="2026-06-11 23:41:15.181748568 +0000 UTC m=+529.699914996" Jun 11 23:41:21.012511 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:21.012479 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c245r" Jun 11 23:41:21.015682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:21.015659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rhvw4" Jun 11 23:41:52.158306 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.158273 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng"] Jun 11 23:41:52.170184 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.170161 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng"] Jun 11 23:41:52.170327 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.170255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.172756 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.172733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5q9ls\"" Jun 11 23:41:52.172906 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.172734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:41:52.173651 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.173626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:41:52.247735 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.247706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.247870 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.247747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.247870 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.247774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgs4\" (UniqueName: \"kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.348326 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.348298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.348463 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.348349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.348463 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.348391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgs4\" (UniqueName: \"kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.348753 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.348733 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.348794 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.348737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.356171 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.356140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgs4\" (UniqueName: \"kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.480703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.480676 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:52.615590 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.615566 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng"] Jun 11 23:41:52.617335 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:52.617307 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a921431_fdb3_45d8_bf60_fcbe49e76c2c.slice/crio-f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274 WatchSource:0}: Error finding container f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274: Status 404 returned error can't find the container with id f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274 Jun 11 23:41:52.959640 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.959606 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl"] Jun 11 23:41:52.963559 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.963538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:52.973629 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:52.973605 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl"] Jun 11 23:41:53.053755 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.053728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.053900 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.053781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.053900 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.053847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqh7g\" (UniqueName: \"kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.154440 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.154411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.154589 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.154476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.154589 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.154521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqh7g\" (UniqueName: \"kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.154795 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.154778 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.154834 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.154812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.162532 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.162511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqh7g\" (UniqueName: \"kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.273741 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.273679 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:53.373148 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.373111 2581 generic.go:356] "Generic (PLEG): container finished" podID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerID="17a73e39049ef889664ed9d35544c99b93fcf7e8787654436b7ead19020c1376" exitCode=0 Jun 11 23:41:53.373291 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.373169 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" event={"ID":"7a921431-fdb3-45d8-bf60-fcbe49e76c2c","Type":"ContainerDied","Data":"17a73e39049ef889664ed9d35544c99b93fcf7e8787654436b7ead19020c1376"} Jun 11 23:41:53.373291 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.373249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" event={"ID":"7a921431-fdb3-45d8-bf60-fcbe49e76c2c","Type":"ContainerStarted","Data":"f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274"} Jun 11 23:41:53.410277 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.410252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl"] Jun 11 23:41:53.411795 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:53.411769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52aa485a_d917_4388_865f_df01e61354ad.slice/crio-5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182 WatchSource:0}: Error finding container 5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182: Status 404 returned error can't find the container with id 5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182 Jun 11 23:41:53.558088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.558062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt"] Jun 11 23:41:53.561744 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.561728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.568339 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.568308 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt"] Jun 11 23:41:53.658399 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.658375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwn4\" (UniqueName: \"kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.658563 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.658416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.658563 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.658536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.759747 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.759714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwn4\" (UniqueName: \"kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.759879 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.759755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.759879 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.759805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.760135 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.760110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.760223 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.760180 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.768071 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.768053 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwn4\" (UniqueName: \"kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.899792 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.899733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:53.955924 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.955899 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m"] Jun 11 23:41:53.959638 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.959620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:53.967731 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:53.967706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m"] Jun 11 23:41:54.048758 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.048734 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt"] Jun 11 23:41:54.059597 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:54.059572 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcf4823_854b_4100_8c3d_b5e4fb0de5e6.slice/crio-b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292 WatchSource:0}: Error finding container b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292: Status 404 returned error can't find the container with id b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292 Jun 11 23:41:54.062651 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.062622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frdm\" (UniqueName: \"kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.062745 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.062730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.062822 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.062801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.163446 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.163418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frdm\" (UniqueName: \"kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.163764 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.163567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.163764 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.163624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.163988 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.163967 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.164088 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.164036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.171970 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.171950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frdm\" (UniqueName: \"kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.275457 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.275433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:54.382126 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.382094 2581 generic.go:356] "Generic (PLEG): container finished" podID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerID="f81dae17783215ac9ad80abf58731a9f193081932dc45cdabb3105e110735ec9" exitCode=0 Jun 11 23:41:54.382282 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.382186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" event={"ID":"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6","Type":"ContainerDied","Data":"f81dae17783215ac9ad80abf58731a9f193081932dc45cdabb3105e110735ec9"} Jun 11 23:41:54.382282 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.382244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" event={"ID":"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6","Type":"ContainerStarted","Data":"b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292"} Jun 11 23:41:54.384691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.384554 2581 generic.go:356] "Generic (PLEG): container finished" podID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerID="0ab2a5921a9608f4d6f7982e2d674994535d88cf986c92bab8585f3eaa8f2a4e" exitCode=0 Jun 11 23:41:54.384691 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.384640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" event={"ID":"7a921431-fdb3-45d8-bf60-fcbe49e76c2c","Type":"ContainerDied","Data":"0ab2a5921a9608f4d6f7982e2d674994535d88cf986c92bab8585f3eaa8f2a4e"} Jun 11 23:41:54.386610 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.386587 2581 generic.go:356] "Generic (PLEG): container finished" podID="52aa485a-d917-4388-865f-df01e61354ad" containerID="1f27bb12d6774c00333e4c034dff68df3f18197844d16d79afba9e24c16e19bd" exitCode=0 Jun 11 23:41:54.386723 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.386637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" event={"ID":"52aa485a-d917-4388-865f-df01e61354ad","Type":"ContainerDied","Data":"1f27bb12d6774c00333e4c034dff68df3f18197844d16d79afba9e24c16e19bd"} Jun 11 23:41:54.386723 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.386673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" event={"ID":"52aa485a-d917-4388-865f-df01e61354ad","Type":"ContainerStarted","Data":"5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182"} Jun 11 23:41:54.413285 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:54.413262 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m"] Jun 11 23:41:54.415351 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:41:54.415329 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898a4e1e_1bc9_4fea_80a1_3dabd0f07f26.slice/crio-1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c WatchSource:0}: Error finding container 1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c: Status 404 returned error can't find the container with id 1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c Jun 11 23:41:55.394810 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.394772 2581 generic.go:356] "Generic (PLEG): container finished" podID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerID="c3551ecbad4da679d2b132694a840f04d31628b106d9f07508f1779b5c094c12" exitCode=0 Jun 11 23:41:55.395155 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.394856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" event={"ID":"7a921431-fdb3-45d8-bf60-fcbe49e76c2c","Type":"ContainerDied","Data":"c3551ecbad4da679d2b132694a840f04d31628b106d9f07508f1779b5c094c12"} Jun 11 23:41:55.396287 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.396263 2581 generic.go:356] "Generic (PLEG): container finished" podID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerID="bbe6d46656c54ecdde6d04e4a3c342dad48be8dbfaa33b79f1d1533516f5cb48" exitCode=0 Jun 11 23:41:55.396375 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.396339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" event={"ID":"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26","Type":"ContainerDied","Data":"bbe6d46656c54ecdde6d04e4a3c342dad48be8dbfaa33b79f1d1533516f5cb48"} Jun 11 23:41:55.396437 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.396377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" event={"ID":"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26","Type":"ContainerStarted","Data":"1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c"} Jun 11 23:41:55.398314 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.398287 2581 generic.go:356] "Generic (PLEG): container finished" podID="52aa485a-d917-4388-865f-df01e61354ad" containerID="44c57a4720e7e8f767e83415d741c9ba7662d252f145ae5282f1a539dca52feb" exitCode=0 Jun 11 23:41:55.398412 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.398377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" event={"ID":"52aa485a-d917-4388-865f-df01e61354ad","Type":"ContainerDied","Data":"44c57a4720e7e8f767e83415d741c9ba7662d252f145ae5282f1a539dca52feb"} Jun 11 23:41:55.400455 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.400414 2581 generic.go:356] "Generic (PLEG): container finished" podID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerID="7d347a7e8a256f947f96358da9cd958a01853d84c40bb5c7b1ab490f1fac7eee" exitCode=0 Jun 11 23:41:55.400455 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:55.400439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" event={"ID":"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6","Type":"ContainerDied","Data":"7d347a7e8a256f947f96358da9cd958a01853d84c40bb5c7b1ab490f1fac7eee"} Jun 11 23:41:56.408473 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.408398 2581 generic.go:356] "Generic (PLEG): container finished" podID="52aa485a-d917-4388-865f-df01e61354ad" containerID="c1a16e2e4c10ae2dc72d3d88dc11baeb529d095a8420ef3dbba21b8cf7f60324" exitCode=0 Jun 11 23:41:56.408869 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.408473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" event={"ID":"52aa485a-d917-4388-865f-df01e61354ad","Type":"ContainerDied","Data":"c1a16e2e4c10ae2dc72d3d88dc11baeb529d095a8420ef3dbba21b8cf7f60324"} Jun 11 23:41:56.410540 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.410520 2581 generic.go:356] "Generic (PLEG): container finished" podID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerID="426831e2a8ca1c950fd3bb6d485500dffd1d43960c8412d51f01be1f1f934e06" exitCode=0 Jun 11 23:41:56.410617 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.410562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" event={"ID":"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6","Type":"ContainerDied","Data":"426831e2a8ca1c950fd3bb6d485500dffd1d43960c8412d51f01be1f1f934e06"} Jun 11 23:41:56.412379 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.412354 2581 generic.go:356] "Generic (PLEG): container finished" podID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerID="6c50809d81360c9553149618ec14d3284306b5bb390abb15928a2090872b9ccb" exitCode=0 Jun 11 23:41:56.412492 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.412431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" event={"ID":"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26","Type":"ContainerDied","Data":"6c50809d81360c9553149618ec14d3284306b5bb390abb15928a2090872b9ccb"} Jun 11 23:41:56.610060 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.610035 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:56.686630 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.686607 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdgs4\" (UniqueName: \"kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4\") pod \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " Jun 11 23:41:56.686773 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.686684 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle\") pod \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " Jun 11 23:41:56.686773 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.686727 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util\") pod \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\" (UID: \"7a921431-fdb3-45d8-bf60-fcbe49e76c2c\") " Jun 11 23:41:56.687242 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.687214 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle" (OuterVolumeSpecName: "bundle") pod "7a921431-fdb3-45d8-bf60-fcbe49e76c2c" (UID: "7a921431-fdb3-45d8-bf60-fcbe49e76c2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:56.688811 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.688782 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4" (OuterVolumeSpecName: "kube-api-access-hdgs4") pod "7a921431-fdb3-45d8-bf60-fcbe49e76c2c" (UID: "7a921431-fdb3-45d8-bf60-fcbe49e76c2c"). InnerVolumeSpecName "kube-api-access-hdgs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:41:56.692015 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.691981 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util" (OuterVolumeSpecName: "util") pod "7a921431-fdb3-45d8-bf60-fcbe49e76c2c" (UID: "7a921431-fdb3-45d8-bf60-fcbe49e76c2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:56.787701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.787672 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdgs4\" (UniqueName: \"kubernetes.io/projected/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-kube-api-access-hdgs4\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:56.787701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.787697 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:56.787701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:56.787706 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a921431-fdb3-45d8-bf60-fcbe49e76c2c-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.419595 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.419560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" event={"ID":"7a921431-fdb3-45d8-bf60-fcbe49e76c2c","Type":"ContainerDied","Data":"f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274"} Jun 11 23:41:57.420044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.419617 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f29fd5a9ead899a5af7d26204300e4a2a4abd780c05a96150411c19922e96274" Jun 11 23:41:57.420044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.419570 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng" Jun 11 23:41:57.421807 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.421780 2581 generic.go:356] "Generic (PLEG): container finished" podID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerID="c59466026e21d280ebaa575460fac6a76d371e907ffd9f5d7d4d8977a214b5c9" exitCode=0 Jun 11 23:41:57.421931 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.421815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" event={"ID":"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26","Type":"ContainerDied","Data":"c59466026e21d280ebaa575460fac6a76d371e907ffd9f5d7d4d8977a214b5c9"} Jun 11 23:41:57.561180 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.561156 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:57.591169 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.591148 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:57.695231 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695203 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqh7g\" (UniqueName: \"kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g\") pod \"52aa485a-d917-4388-865f-df01e61354ad\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " Jun 11 23:41:57.695231 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695232 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjwn4\" (UniqueName: \"kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4\") pod \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " Jun 11 23:41:57.695438 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695268 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util\") pod \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " Jun 11 23:41:57.695438 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695301 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util\") pod \"52aa485a-d917-4388-865f-df01e61354ad\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " Jun 11 23:41:57.695514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695437 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle\") pod \"52aa485a-d917-4388-865f-df01e61354ad\" (UID: \"52aa485a-d917-4388-865f-df01e61354ad\") " Jun 11 23:41:57.695514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695467 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle\") pod \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\" (UID: \"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6\") " Jun 11 23:41:57.695942 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.695908 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle" (OuterVolumeSpecName: "bundle") pod "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" (UID: "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:57.696164 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.696145 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle" (OuterVolumeSpecName: "bundle") pod "52aa485a-d917-4388-865f-df01e61354ad" (UID: "52aa485a-d917-4388-865f-df01e61354ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:57.697877 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.697851 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g" (OuterVolumeSpecName: "kube-api-access-nqh7g") pod "52aa485a-d917-4388-865f-df01e61354ad" (UID: "52aa485a-d917-4388-865f-df01e61354ad"). InnerVolumeSpecName "kube-api-access-nqh7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:41:57.697976 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.697888 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4" (OuterVolumeSpecName: "kube-api-access-cjwn4") pod "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" (UID: "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6"). InnerVolumeSpecName "kube-api-access-cjwn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:41:57.701116 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.701094 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util" (OuterVolumeSpecName: "util") pod "52aa485a-d917-4388-865f-df01e61354ad" (UID: "52aa485a-d917-4388-865f-df01e61354ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:57.701466 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.701447 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util" (OuterVolumeSpecName: "util") pod "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" (UID: "ebcf4823-854b-4100-8c3d-b5e4fb0de5e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:57.796303 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796277 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqh7g\" (UniqueName: \"kubernetes.io/projected/52aa485a-d917-4388-865f-df01e61354ad-kube-api-access-nqh7g\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.796303 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796300 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjwn4\" (UniqueName: \"kubernetes.io/projected/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-kube-api-access-cjwn4\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.796436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796310 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.796436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796319 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.796436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796326 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52aa485a-d917-4388-865f-df01e61354ad-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:57.796436 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:57.796333 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebcf4823-854b-4100-8c3d-b5e4fb0de5e6-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:58.428855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.428830 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" Jun 11 23:41:58.429239 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.428851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl" event={"ID":"52aa485a-d917-4388-865f-df01e61354ad","Type":"ContainerDied","Data":"5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182"} Jun 11 23:41:58.429239 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.428899 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c4a997f00776138cc976230e8e1e1406ba03949420aa2577075884c41847182" Jun 11 23:41:58.431027 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.430972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" event={"ID":"ebcf4823-854b-4100-8c3d-b5e4fb0de5e6","Type":"ContainerDied","Data":"b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292"} Jun 11 23:41:58.431027 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.431018 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt" Jun 11 23:41:58.431197 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.431031 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b788f479c82958de5119512008a7fbf719d79fd6efcd215587c4051c58bca292" Jun 11 23:41:58.567985 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.567962 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:58.704224 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.704197 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util\") pod \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " Jun 11 23:41:58.704419 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.704241 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7frdm\" (UniqueName: \"kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm\") pod \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " Jun 11 23:41:58.704419 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.704279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle\") pod \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\" (UID: \"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26\") " Jun 11 23:41:58.704779 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.704758 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle" (OuterVolumeSpecName: "bundle") pod "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" (UID: "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:58.706405 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.706388 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm" (OuterVolumeSpecName: "kube-api-access-7frdm") pod "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" (UID: "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26"). InnerVolumeSpecName "kube-api-access-7frdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:41:58.709770 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.709744 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util" (OuterVolumeSpecName: "util") pod "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" (UID: "898a4e1e-1bc9-4fea-80a1-3dabd0f07f26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:41:58.804989 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.804955 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:58.804989 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.804985 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7frdm\" (UniqueName: \"kubernetes.io/projected/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-kube-api-access-7frdm\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:58.805159 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:58.805022 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/898a4e1e-1bc9-4fea-80a1-3dabd0f07f26-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:41:59.438234 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:59.438201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" event={"ID":"898a4e1e-1bc9-4fea-80a1-3dabd0f07f26","Type":"ContainerDied","Data":"1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c"} Jun 11 23:41:59.438234 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:59.438223 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m" Jun 11 23:41:59.438650 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:41:59.438253 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f2abbcbc6686db1abf4422561ae383da743266a7537fa87d27f7aff9db6100c" Jun 11 23:42:20.256208 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256174 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk"] Jun 11 23:42:20.256545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256519 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="extract" Jun 11 23:42:20.256545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256530 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="extract" Jun 11 23:42:20.256545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256538 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="util" Jun 11 23:42:20.256545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256545 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256559 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256564 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256576 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256581 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256586 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256591 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256601 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256606 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256611 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256615 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256623 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256628 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256633 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256638 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="extract" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256643 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256648 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256656 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256661 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="util" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256669 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="pull" Jun 11 23:42:20.256682 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256674 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="pull" Jun 11 23:42:20.257471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256728 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a921431-fdb3-45d8-bf60-fcbe49e76c2c" containerName="extract" Jun 11 23:42:20.257471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256738 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="52aa485a-d917-4388-865f-df01e61354ad" containerName="extract" Jun 11 23:42:20.257471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256747 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="898a4e1e-1bc9-4fea-80a1-3dabd0f07f26" containerName="extract" Jun 11 23:42:20.257471 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.256753 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebcf4823-854b-4100-8c3d-b5e4fb0de5e6" containerName="extract" Jun 11 23:42:20.259926 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.259907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:20.262232 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.262211 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 23:42:20.262326 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.262254 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 23:42:20.263135 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.263119 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nbmwj\"" Jun 11 23:42:20.267892 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.267869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk"] Jun 11 23:42:20.278267 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.278244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p546j\" (UniqueName: \"kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j\") pod \"limitador-operator-controller-manager-859d7b78bd-5plhk\" (UID: \"5631e1f9-fd3a-49d7-a327-8ae343d37329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:20.379263 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.379238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p546j\" (UniqueName: \"kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j\") pod \"limitador-operator-controller-manager-859d7b78bd-5plhk\" (UID: \"5631e1f9-fd3a-49d7-a327-8ae343d37329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:20.388435 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.388410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p546j\" (UniqueName: \"kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j\") pod \"limitador-operator-controller-manager-859d7b78bd-5plhk\" (UID: \"5631e1f9-fd3a-49d7-a327-8ae343d37329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:20.572091 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.572038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:20.710892 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:20.710869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk"] Jun 11 23:42:20.712614 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:42:20.712588 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5631e1f9_fd3a_49d7_a327_8ae343d37329.slice/crio-2809f222ab89a1d55348817cf73712f91c601de63b9d8f68ed47cb41b1addce9 WatchSource:0}: Error finding container 2809f222ab89a1d55348817cf73712f91c601de63b9d8f68ed47cb41b1addce9: Status 404 returned error can't find the container with id 2809f222ab89a1d55348817cf73712f91c601de63b9d8f68ed47cb41b1addce9 Jun 11 23:42:21.566835 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:21.566802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" event={"ID":"5631e1f9-fd3a-49d7-a327-8ae343d37329","Type":"ContainerStarted","Data":"2809f222ab89a1d55348817cf73712f91c601de63b9d8f68ed47cb41b1addce9"} Jun 11 23:42:22.574618 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:22.574585 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" event={"ID":"5631e1f9-fd3a-49d7-a327-8ae343d37329","Type":"ContainerStarted","Data":"6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2"} Jun 11 23:42:22.575055 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:22.574654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:22.591148 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:22.591098 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" podStartSLOduration=0.885084921 podStartE2EDuration="2.591084443s" totalImagesPullingTime="1.705999522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:22.588645196 +0000 UTC m=+597.106811652" watchObservedRunningTime="2026-06-11 23:42:22.591084443 +0000 UTC m=+597.109250870" Jun 11 23:42:25.988473 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:25.988444 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:42:25.988473 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:25.988461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:42:33.583414 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:33.583378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:34.685146 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.685105 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk"] Jun 11 23:42:34.687590 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.685363 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" containerName="manager" containerID="cri-o://6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2" gracePeriod=2 Jun 11 23:42:34.692867 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.692841 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk"] Jun 11 23:42:34.728212 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.728178 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5"] Jun 11 23:42:34.728887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.728845 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" containerName="manager" Jun 11 23:42:34.728887 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.728876 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" containerName="manager" Jun 11 23:42:34.729879 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.729028 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" containerName="manager" Jun 11 23:42:34.732506 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.732483 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:34.754575 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.754552 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5"] Jun 11 23:42:34.778167 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:34.778133 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5plhk\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:34.798060 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.798038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzb5d\" (UniqueName: \"kubernetes.io/projected/9c446ab6-4b77-4830-a84f-371717f1593a-kube-api-access-fzb5d\") pod \"limitador-operator-controller-manager-859d7b78bd-cdln5\" (UID: \"9c446ab6-4b77-4830-a84f-371717f1593a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:34.898692 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.898658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzb5d\" (UniqueName: \"kubernetes.io/projected/9c446ab6-4b77-4830-a84f-371717f1593a-kube-api-access-fzb5d\") pod \"limitador-operator-controller-manager-859d7b78bd-cdln5\" (UID: \"9c446ab6-4b77-4830-a84f-371717f1593a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:34.915920 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.915894 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzb5d\" (UniqueName: \"kubernetes.io/projected/9c446ab6-4b77-4830-a84f-371717f1593a-kube-api-access-fzb5d\") pod \"limitador-operator-controller-manager-859d7b78bd-cdln5\" (UID: \"9c446ab6-4b77-4830-a84f-371717f1593a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:34.936364 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.936302 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:34.939604 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:34.939580 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5plhk\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:34.999534 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:34.999510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p546j\" (UniqueName: \"kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j\") pod \"5631e1f9-fd3a-49d7-a327-8ae343d37329\" (UID: \"5631e1f9-fd3a-49d7-a327-8ae343d37329\") " Jun 11 23:42:35.001384 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.001363 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j" (OuterVolumeSpecName: "kube-api-access-p546j") pod "5631e1f9-fd3a-49d7-a327-8ae343d37329" (UID: "5631e1f9-fd3a-49d7-a327-8ae343d37329"). InnerVolumeSpecName "kube-api-access-p546j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:42:35.066611 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.066587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:35.100292 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.100266 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p546j\" (UniqueName: \"kubernetes.io/projected/5631e1f9-fd3a-49d7-a327-8ae343d37329-kube-api-access-p546j\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:42:35.208923 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.208898 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5"] Jun 11 23:42:35.210220 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:42:35.210183 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c446ab6_4b77_4830_a84f_371717f1593a.slice/crio-86ad900aa1f8bed8c410bc6eea161bb6ec47cfbcc1475d62eec528a82c6cc02d WatchSource:0}: Error finding container 86ad900aa1f8bed8c410bc6eea161bb6ec47cfbcc1475d62eec528a82c6cc02d: Status 404 returned error can't find the container with id 86ad900aa1f8bed8c410bc6eea161bb6ec47cfbcc1475d62eec528a82c6cc02d Jun 11 23:42:35.647249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.647147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" event={"ID":"9c446ab6-4b77-4830-a84f-371717f1593a","Type":"ContainerStarted","Data":"8966bccbd59122ac684dad5c11d8d81415901c4a693a13452bddf9886d39d037"} Jun 11 23:42:35.647249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.647218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" event={"ID":"9c446ab6-4b77-4830-a84f-371717f1593a","Type":"ContainerStarted","Data":"86ad900aa1f8bed8c410bc6eea161bb6ec47cfbcc1475d62eec528a82c6cc02d"} Jun 11 23:42:35.647458 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.647295 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:42:35.648470 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.648445 2581 generic.go:356] "Generic (PLEG): container finished" podID="5631e1f9-fd3a-49d7-a327-8ae343d37329" containerID="6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2" exitCode=0 Jun 11 23:42:35.648601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.648486 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:35.648601 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.648545 2581 scope.go:117] "RemoveContainer" containerID="6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2" Jun 11 23:42:35.649804 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:35.649779 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5plhk\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:35.657395 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.657380 2581 scope.go:117] "RemoveContainer" containerID="6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2" Jun 11 23:42:35.657630 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:35.657608 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2\": container with ID starting with 6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2 not found: ID does not exist" containerID="6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2" Jun 11 23:42:35.657697 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.657639 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2"} err="failed to get container status \"6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2\": rpc error: code = NotFound desc = could not find container \"6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2\": container with ID starting with 6f9bb4fef524dbc298500302f7377d1edbf92cfe1a6151e6d30a32f8635113a2 not found: ID does not exist" Jun 11 23:42:35.693545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.693503 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" podStartSLOduration=1.693490457 podStartE2EDuration="1.693490457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:35.692245269 +0000 UTC m=+610.210411697" watchObservedRunningTime="2026-06-11 23:42:35.693490457 +0000 UTC m=+610.211656884" Jun 11 23:42:35.694742 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:35.694719 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5plhk\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:35.980764 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:42:35.980735 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5plhk\" is forbidden: User \"system:node:ip-10-0-129-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-57.ec2.internal' and this object" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5plhk" Jun 11 23:42:35.982332 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:35.982305 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5631e1f9-fd3a-49d7-a327-8ae343d37329" path="/var/lib/kubelet/pods/5631e1f9-fd3a-49d7-a327-8ae343d37329/volumes" Jun 11 23:42:46.657184 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:42:46.657104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cdln5" Jun 11 23:43:10.390675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.390639 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:43:10.394450 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.394427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.396664 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.396632 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 23:43:10.396779 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.396750 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5q9ls\"" Jun 11 23:43:10.401681 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.401656 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:43:10.435126 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.435102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:43:10.591558 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.591532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgfxq\" (UniqueName: \"kubernetes.io/projected/3fbd754d-3f5f-4062-8c06-433201561e30-kube-api-access-pgfxq\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.591708 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.591575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fbd754d-3f5f-4062-8c06-433201561e30-config-file\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.692372 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.692343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgfxq\" (UniqueName: \"kubernetes.io/projected/3fbd754d-3f5f-4062-8c06-433201561e30-kube-api-access-pgfxq\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.692496 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.692415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fbd754d-3f5f-4062-8c06-433201561e30-config-file\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.693029 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.693008 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3fbd754d-3f5f-4062-8c06-433201561e30-config-file\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.700935 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.700915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgfxq\" (UniqueName: \"kubernetes.io/projected/3fbd754d-3f5f-4062-8c06-433201561e30-kube-api-access-pgfxq\") pod \"limitador-limitador-54d6d988d5-slpwz\" (UID: \"3fbd754d-3f5f-4062-8c06-433201561e30\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.705768 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.705749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:10.836551 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.836521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:43:10.837738 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:43:10.837715 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbd754d_3f5f_4062_8c06_433201561e30.slice/crio-85044c61ea0b81889bfd0c40bdc7546a47424c0ee6bf83b88385ed825ed77a77 WatchSource:0}: Error finding container 85044c61ea0b81889bfd0c40bdc7546a47424c0ee6bf83b88385ed825ed77a77: Status 404 returned error can't find the container with id 85044c61ea0b81889bfd0c40bdc7546a47424c0ee6bf83b88385ed825ed77a77 Jun 11 23:43:10.839517 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.839499 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:43:10.852177 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:10.852150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" event={"ID":"3fbd754d-3f5f-4062-8c06-433201561e30","Type":"ContainerStarted","Data":"85044c61ea0b81889bfd0c40bdc7546a47424c0ee6bf83b88385ed825ed77a77"} Jun 11 23:43:13.872541 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:13.872512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" event={"ID":"3fbd754d-3f5f-4062-8c06-433201561e30","Type":"ContainerStarted","Data":"64b25341523c5d2bfe5b8d5d9e05faf9b4e0228cc18f3a3c9775d7b6a3f9520c"} Jun 11 23:43:13.872897 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:13.872586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:13.889012 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:13.888945 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" podStartSLOduration=1.466112913 podStartE2EDuration="3.888930208s" totalImagesPullingTime="2.422817295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:13.887170593 +0000 UTC m=+648.405337043" watchObservedRunningTime="2026-06-11 23:43:13.888930208 +0000 UTC m=+648.407096636" Jun 11 23:43:24.879167 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:24.879135 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-slpwz" Jun 11 23:43:37.849537 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.849505 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj"] Jun 11 23:43:37.855061 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.855044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:37.857314 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.857290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 23:43:37.858586 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.858566 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rpb9s\"" Jun 11 23:43:37.858878 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.858858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 23:43:37.862713 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.862688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj"] Jun 11 23:43:37.910902 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.910881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:37.911030 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.910959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5xj\" (UniqueName: \"kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:37.911083 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:37.911031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.011931 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.011900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5xj\" (UniqueName: \"kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.012085 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.011953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.012085 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.012032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.012348 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.012328 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.012393 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.012349 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.020918 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.020896 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5xj\" (UniqueName: \"kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.166789 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.166770 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:38.304136 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:43:38.304098 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded13fb24_f6f4_450f_b448_63b7f8f1e233.slice/crio-589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef WatchSource:0}: Error finding container 589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef: Status 404 returned error can't find the container with id 589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef Jun 11 23:43:38.304478 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:38.304454 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj"] Jun 11 23:43:39.020771 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:39.020739 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerID="5add940322a20a9fda97232fb23830d7ddb64534f03b2eaa00396e8008388b1b" exitCode=0 Jun 11 23:43:39.021170 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:39.020824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" event={"ID":"ed13fb24-f6f4-450f-b448-63b7f8f1e233","Type":"ContainerDied","Data":"5add940322a20a9fda97232fb23830d7ddb64534f03b2eaa00396e8008388b1b"} Jun 11 23:43:39.021170 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:39.020877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" event={"ID":"ed13fb24-f6f4-450f-b448-63b7f8f1e233","Type":"ContainerStarted","Data":"589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef"} Jun 11 23:43:40.027338 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:40.027307 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerID="92260430a6cd589e0ab1262b28d4afa6b09e95a22295b9759578d13ce2484a14" exitCode=0 Jun 11 23:43:40.027711 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:40.027392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" event={"ID":"ed13fb24-f6f4-450f-b448-63b7f8f1e233","Type":"ContainerDied","Data":"92260430a6cd589e0ab1262b28d4afa6b09e95a22295b9759578d13ce2484a14"} Jun 11 23:43:41.035489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:41.035460 2581 generic.go:356] "Generic (PLEG): container finished" podID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerID="a6ee312bb75862b51c2103c9edb528ad25a3644838f2313c77d7cbf38b79bc07" exitCode=0 Jun 11 23:43:41.035855 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:41.035513 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" event={"ID":"ed13fb24-f6f4-450f-b448-63b7f8f1e233","Type":"ContainerDied","Data":"a6ee312bb75862b51c2103c9edb528ad25a3644838f2313c77d7cbf38b79bc07"} Jun 11 23:43:42.175171 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.175149 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:42.249241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.249214 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw5xj\" (UniqueName: \"kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj\") pod \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " Jun 11 23:43:42.249393 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.249279 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle\") pod \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " Jun 11 23:43:42.249484 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.249446 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util\") pod \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\" (UID: \"ed13fb24-f6f4-450f-b448-63b7f8f1e233\") " Jun 11 23:43:42.249759 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.249739 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle" (OuterVolumeSpecName: "bundle") pod "ed13fb24-f6f4-450f-b448-63b7f8f1e233" (UID: "ed13fb24-f6f4-450f-b448-63b7f8f1e233"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:43:42.251325 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.251299 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj" (OuterVolumeSpecName: "kube-api-access-jw5xj") pod "ed13fb24-f6f4-450f-b448-63b7f8f1e233" (UID: "ed13fb24-f6f4-450f-b448-63b7f8f1e233"). InnerVolumeSpecName "kube-api-access-jw5xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:43:42.258138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.258114 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util" (OuterVolumeSpecName: "util") pod "ed13fb24-f6f4-450f-b448-63b7f8f1e233" (UID: "ed13fb24-f6f4-450f-b448-63b7f8f1e233"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 23:43:42.350529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.350452 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw5xj\" (UniqueName: \"kubernetes.io/projected/ed13fb24-f6f4-450f-b448-63b7f8f1e233-kube-api-access-jw5xj\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:43:42.350529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.350489 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-bundle\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:43:42.350529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:42.350502 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed13fb24-f6f4-450f-b448-63b7f8f1e233-util\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:43:43.049309 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:43.049284 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" Jun 11 23:43:43.049448 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:43.049306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748x4lxj" event={"ID":"ed13fb24-f6f4-450f-b448-63b7f8f1e233","Type":"ContainerDied","Data":"589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef"} Jun 11 23:43:43.049448 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:43:43.049349 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="589382ff941f3cdb40877c32fb14f1c859d5e1a03b0c54d1e211bd8785e1b3ef" Jun 11 23:44:35.390073 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.389979 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390406 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="extract" Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390420 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="extract" Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390432 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="pull" Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390438 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="pull" Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390447 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="util" Jun 11 23:44:35.390502 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390452 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="util" Jun 11 23:44:35.390738 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.390522 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed13fb24-f6f4-450f-b448-63b7f8f1e233" containerName="extract" Jun 11 23:44:35.393612 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.393597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.395674 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.395653 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 23:44:35.396859 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.396726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lmbdl\"" Jun 11 23:44:35.397077 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.397059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 23:44:35.400395 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.400375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:44:35.500124 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.500095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.500279 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.500157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvr29\" (UniqueName: \"kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.600847 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.600820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.600950 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.600866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvr29\" (UniqueName: \"kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.603193 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.603169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.609836 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.609814 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvr29\" (UniqueName: \"kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29\") pod \"maas-controller-79b64d6b4-89t47\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.706193 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.706167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:35.838287 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:35.838257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:44:35.839054 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:44:35.839023 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9a22e3_b8ea_472c_ada3_d5b86250489f.slice/crio-392b65ca39c8d308d4301a2f33c50c75a863571c36530f7ed92459badff188a9 WatchSource:0}: Error finding container 392b65ca39c8d308d4301a2f33c50c75a863571c36530f7ed92459badff188a9: Status 404 returned error can't find the container with id 392b65ca39c8d308d4301a2f33c50c75a863571c36530f7ed92459badff188a9 Jun 11 23:44:36.347322 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:36.347283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-89t47" event={"ID":"6c9a22e3-b8ea-472c-ada3-d5b86250489f","Type":"ContainerStarted","Data":"392b65ca39c8d308d4301a2f33c50c75a863571c36530f7ed92459badff188a9"} Jun 11 23:44:38.362370 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:38.362330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-89t47" event={"ID":"6c9a22e3-b8ea-472c-ada3-d5b86250489f","Type":"ContainerStarted","Data":"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50"} Jun 11 23:44:38.362799 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:38.362448 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:44:38.379848 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:38.379803 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79b64d6b4-89t47" podStartSLOduration=0.986432385 podStartE2EDuration="3.379789541s" totalImagesPullingTime="2.393357156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:44:38.37841873 +0000 UTC m=+732.896585161" watchObservedRunningTime="2026-06-11 23:44:38.379789541 +0000 UTC m=+732.897955969" Jun 11 23:44:49.373716 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:44:49.373682 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:45:09.362083 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.362050 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4nfxn"] Jun 11 23:45:09.365933 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.365912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:09.368426 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.368389 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 23:45:09.368557 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.368389 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7sw2b\"" Jun 11 23:45:09.374895 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.374871 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4nfxn"] Jun 11 23:45:09.393615 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.393579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfcs\" (UniqueName: \"kubernetes.io/projected/7e561f0c-2e50-4e68-b1ab-48f1fc2076e2-kube-api-access-mtfcs\") pod \"payload-pre-processing-579785bc64-4nfxn\" (UID: \"7e561f0c-2e50-4e68-b1ab-48f1fc2076e2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:09.398044 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.398019 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8ldfw"] Jun 11 23:45:09.401462 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.401444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:09.409899 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.409877 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8ldfw"] Jun 11 23:45:09.494807 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.494778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfcs\" (UniqueName: \"kubernetes.io/projected/7e561f0c-2e50-4e68-b1ab-48f1fc2076e2-kube-api-access-mtfcs\") pod \"payload-pre-processing-579785bc64-4nfxn\" (UID: \"7e561f0c-2e50-4e68-b1ab-48f1fc2076e2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:09.494964 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.494843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25tz\" (UniqueName: \"kubernetes.io/projected/6483fefd-decb-406d-b9dc-9055c5ff202f-kube-api-access-w25tz\") pod \"payload-processing-699b6cd6c-8ldfw\" (UID: \"6483fefd-decb-406d-b9dc-9055c5ff202f\") " pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:09.502689 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.502660 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfcs\" (UniqueName: \"kubernetes.io/projected/7e561f0c-2e50-4e68-b1ab-48f1fc2076e2-kube-api-access-mtfcs\") pod \"payload-pre-processing-579785bc64-4nfxn\" (UID: \"7e561f0c-2e50-4e68-b1ab-48f1fc2076e2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:09.595438 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.595407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25tz\" (UniqueName: \"kubernetes.io/projected/6483fefd-decb-406d-b9dc-9055c5ff202f-kube-api-access-w25tz\") pod \"payload-processing-699b6cd6c-8ldfw\" (UID: \"6483fefd-decb-406d-b9dc-9055c5ff202f\") " pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:09.604166 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.604134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25tz\" (UniqueName: \"kubernetes.io/projected/6483fefd-decb-406d-b9dc-9055c5ff202f-kube-api-access-w25tz\") pod \"payload-processing-699b6cd6c-8ldfw\" (UID: \"6483fefd-decb-406d-b9dc-9055c5ff202f\") " pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:09.627687 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.627624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:45:09.678167 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.678137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:09.712658 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.712624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:09.831846 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.831813 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4nfxn"] Jun 11 23:45:09.834009 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:45:09.833972 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e561f0c_2e50_4e68_b1ab_48f1fc2076e2.slice/crio-81dadfbe935038f554b34c45885d8ca9dee6a5910075261997350461eee58222 WatchSource:0}: Error finding container 81dadfbe935038f554b34c45885d8ca9dee6a5910075261997350461eee58222: Status 404 returned error can't find the container with id 81dadfbe935038f554b34c45885d8ca9dee6a5910075261997350461eee58222 Jun 11 23:45:09.868292 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:09.868267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-8ldfw"] Jun 11 23:45:09.870320 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:45:09.870287 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6483fefd_decb_406d_b9dc_9055c5ff202f.slice/crio-8f1cb703f045da285a42e448a217b2654c9dbdc009395c5d5937377518a076de WatchSource:0}: Error finding container 8f1cb703f045da285a42e448a217b2654c9dbdc009395c5d5937377518a076de: Status 404 returned error can't find the container with id 8f1cb703f045da285a42e448a217b2654c9dbdc009395c5d5937377518a076de Jun 11 23:45:10.556160 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:10.555969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" event={"ID":"6483fefd-decb-406d-b9dc-9055c5ff202f","Type":"ContainerStarted","Data":"8f1cb703f045da285a42e448a217b2654c9dbdc009395c5d5937377518a076de"} Jun 11 23:45:10.559070 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:10.558988 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" event={"ID":"7e561f0c-2e50-4e68-b1ab-48f1fc2076e2","Type":"ContainerStarted","Data":"81dadfbe935038f554b34c45885d8ca9dee6a5910075261997350461eee58222"} Jun 11 23:45:12.573701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.573665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" event={"ID":"6483fefd-decb-406d-b9dc-9055c5ff202f","Type":"ContainerStarted","Data":"83124964241c2416ff34caf1dc33766ba033d2d6ea1b25e362a15c37cfac1200"} Jun 11 23:45:12.574097 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.573756 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:12.575367 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.575349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" event={"ID":"7e561f0c-2e50-4e68-b1ab-48f1fc2076e2","Type":"ContainerStarted","Data":"076ec396932cb55b5b4ae58a77a4b31252dd5192fd74e87856d17b03f9284749"} Jun 11 23:45:12.575459 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.575388 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:45:12.589901 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.589855 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" podStartSLOduration=0.979633116 podStartE2EDuration="3.589841916s" totalImagesPullingTime="2.6102088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:45:12.587249056 +0000 UTC m=+767.105415484" watchObservedRunningTime="2026-06-11 23:45:12.589841916 +0000 UTC m=+767.108008343" Jun 11 23:45:12.601552 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:12.601511 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" podStartSLOduration=0.95033362 podStartE2EDuration="3.60149916s" totalImagesPullingTime="2.65116554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:45:12.600452354 +0000 UTC m=+767.118618783" watchObservedRunningTime="2026-06-11 23:45:12.60149916 +0000 UTC m=+767.119665608" Jun 11 23:45:23.582589 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:23.582556 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-8ldfw" Jun 11 23:45:23.582960 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:45:23.582711 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4nfxn" Jun 11 23:46:22.029917 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:22.029880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:46:27.293358 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.293321 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67"] Jun 11 23:46:27.297675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.297649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.300270 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.300248 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 23:46:27.301118 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.301096 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-29q9n\"" Jun 11 23:46:27.301253 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.301116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 23:46:27.301253 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.301130 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 23:46:27.307173 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.307149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67"] Jun 11 23:46:27.417427 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.417578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.417578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4tjl\" (UniqueName: \"kubernetes.io/projected/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kube-api-access-n4tjl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.417578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.417578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.417578 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.417549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518530 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518675 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4tjl\" (UniqueName: \"kubernetes.io/projected/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kube-api-access-n4tjl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.518806 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.518787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.519055 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.519032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.519186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.519068 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.519186 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.519153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.520761 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.520729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.521055 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.521036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.528006 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.527976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4tjl\" (UniqueName: \"kubernetes.io/projected/f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a-kube-api-access-n4tjl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dqm67\" (UID: \"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.611181 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.611120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:46:27.748766 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.748737 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67"] Jun 11 23:46:27.750836 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:46:27.750808 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bbb3fe_7615_4a1f_8bd5_c732a2eb456a.slice/crio-c933bbdf66b8ca990a77af324fa3858fb051d2f33d1bd3cd9f570ef47487692f WatchSource:0}: Error finding container c933bbdf66b8ca990a77af324fa3858fb051d2f33d1bd3cd9f570ef47487692f: Status 404 returned error can't find the container with id c933bbdf66b8ca990a77af324fa3858fb051d2f33d1bd3cd9f570ef47487692f Jun 11 23:46:27.821987 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:27.821962 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:46:28.022988 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:28.022947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" event={"ID":"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a","Type":"ContainerStarted","Data":"c933bbdf66b8ca990a77af324fa3858fb051d2f33d1bd3cd9f570ef47487692f"} Jun 11 23:46:31.046307 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:31.046269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" event={"ID":"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a","Type":"ContainerStarted","Data":"0a6272964921b3b27a0649dc88f717f2d47064e5e6e8060b08b1f3523cf90682"} Jun 11 23:46:43.902753 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:43.902719 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l"] Jun 11 23:46:43.909953 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:43.909300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:43.913095 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:43.913071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 23:46:43.923853 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:43.923823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l"] Jun 11 23:46:44.048250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517e4ccd-56bf-4a5a-829c-b4d209377cf9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.048412 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.048456 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.048503 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.048572 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwcv\" (UniqueName: \"kubernetes.io/projected/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kube-api-access-knwcv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.048638 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.048592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.149890 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.149857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.149890 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.149894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwcv\" (UniqueName: \"kubernetes.io/projected/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kube-api-access-knwcv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.149933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.149969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517e4ccd-56bf-4a5a-829c-b4d209377cf9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.150010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.150102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150347 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.150298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150448 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.150424 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.150505 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.150457 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.152226 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.152196 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/517e4ccd-56bf-4a5a-829c-b4d209377cf9-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.152396 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.152378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/517e4ccd-56bf-4a5a-829c-b4d209377cf9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.157595 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.157533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwcv\" (UniqueName: \"kubernetes.io/projected/517e4ccd-56bf-4a5a-829c-b4d209377cf9-kube-api-access-knwcv\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l\" (UID: \"517e4ccd-56bf-4a5a-829c-b4d209377cf9\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.245542 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.245514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:44.382767 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.382736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l"] Jun 11 23:46:44.384204 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:46:44.384174 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517e4ccd_56bf_4a5a_829c_b4d209377cf9.slice/crio-524aa1b660c29686dcf84e0a799a76adf81c4c69449955e2a99a871132cee631 WatchSource:0}: Error finding container 524aa1b660c29686dcf84e0a799a76adf81c4c69449955e2a99a871132cee631: Status 404 returned error can't find the container with id 524aa1b660c29686dcf84e0a799a76adf81c4c69449955e2a99a871132cee631 Jun 11 23:46:44.626138 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:44.626100 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:46:45.128514 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:45.128481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" event={"ID":"517e4ccd-56bf-4a5a-829c-b4d209377cf9","Type":"ContainerStarted","Data":"1e5016ec04fea6b5aff056e7d0409b61a42d231c54bce29401d8c469a832182f"} Jun 11 23:46:45.128863 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:45.128536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" event={"ID":"517e4ccd-56bf-4a5a-829c-b4d209377cf9","Type":"ContainerStarted","Data":"524aa1b660c29686dcf84e0a799a76adf81c4c69449955e2a99a871132cee631"} Jun 11 23:46:46.135662 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:46.135582 2581 generic.go:356] "Generic (PLEG): container finished" podID="517e4ccd-56bf-4a5a-829c-b4d209377cf9" containerID="1e5016ec04fea6b5aff056e7d0409b61a42d231c54bce29401d8c469a832182f" exitCode=0 Jun 11 23:46:46.136008 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:46.135667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" event={"ID":"517e4ccd-56bf-4a5a-829c-b4d209377cf9","Type":"ContainerDied","Data":"1e5016ec04fea6b5aff056e7d0409b61a42d231c54bce29401d8c469a832182f"} Jun 11 23:46:48.150439 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:48.150406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" event={"ID":"517e4ccd-56bf-4a5a-829c-b4d209377cf9","Type":"ContainerStarted","Data":"83cb684db5d853076d37777373d641c9d73a3a8deaebd7401474b2ff1cce54a1"} Jun 11 23:46:48.172064 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:48.172020 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" podStartSLOduration=2.845143745 podStartE2EDuration="5.172006529s" totalImagesPullingTime="1.077851094s" totalInitContainerRuntime="1.24901169s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:46:48.169736121 +0000 UTC m=+862.687902546" watchObservedRunningTime="2026-06-11 23:46:48.172006529 +0000 UTC m=+862.690172947" Jun 11 23:46:54.246561 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:54.246536 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:54.247072 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:54.246610 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:54.258800 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:54.258783 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:46:55.199967 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:46:55.199936 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l" Jun 11 23:47:00.422244 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:00.422214 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:47:14.726345 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:14.726276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:47:22.592536 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.592503 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs"] Jun 11 23:47:22.599619 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.599600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.602597 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.602577 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 23:47:22.604397 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.604375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs"] Jun 11 23:47:22.662845 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.662808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.663120 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.663095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.663254 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.663131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.663318 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.663244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.663672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.663377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dfs\" (UniqueName: \"kubernetes.io/projected/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kube-api-access-r7dfs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.663672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.663420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764201 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764349 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dfs\" (UniqueName: \"kubernetes.io/projected/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kube-api-access-r7dfs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764349 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764349 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764349 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764576 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764788 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764874 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.764915 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.764877 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.766785 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.766749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.767033 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.767016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.771545 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.771524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dfs\" (UniqueName: \"kubernetes.io/projected/e196ebbe-ec22-4881-9b93-d53d4e4b02b7-kube-api-access-r7dfs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-2f5fs\" (UID: \"e196ebbe-ec22-4881-9b93-d53d4e4b02b7\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:22.911252 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:22.911191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:23.056048 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:23.056022 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs"] Jun 11 23:47:23.057562 ip-10-0-129-57 kubenswrapper[2581]: W0611 23:47:23.057538 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode196ebbe_ec22_4881_9b93_d53d4e4b02b7.slice/crio-c5d5ed4759ff9c31b8f64eefa0dbb68725e5391658009e1376872d74b7be7b72 WatchSource:0}: Error finding container c5d5ed4759ff9c31b8f64eefa0dbb68725e5391658009e1376872d74b7be7b72: Status 404 returned error can't find the container with id c5d5ed4759ff9c31b8f64eefa0dbb68725e5391658009e1376872d74b7be7b72 Jun 11 23:47:23.353683 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:23.353628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" event={"ID":"e196ebbe-ec22-4881-9b93-d53d4e4b02b7","Type":"ContainerStarted","Data":"babb224e289ee9751c9b1c283094be287ce5731a85a973bf6861f2763203ca89"} Jun 11 23:47:23.353882 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:23.353687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" event={"ID":"e196ebbe-ec22-4881-9b93-d53d4e4b02b7","Type":"ContainerStarted","Data":"c5d5ed4759ff9c31b8f64eefa0dbb68725e5391658009e1376872d74b7be7b72"} Jun 11 23:47:23.821695 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:23.821661 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:47:25.367554 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:25.367522 2581 generic.go:356] "Generic (PLEG): container finished" podID="e196ebbe-ec22-4881-9b93-d53d4e4b02b7" containerID="babb224e289ee9751c9b1c283094be287ce5731a85a973bf6861f2763203ca89" exitCode=0 Jun 11 23:47:25.368140 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:25.367597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" event={"ID":"e196ebbe-ec22-4881-9b93-d53d4e4b02b7","Type":"ContainerDied","Data":"babb224e289ee9751c9b1c283094be287ce5731a85a973bf6861f2763203ca89"} Jun 11 23:47:26.030005 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:26.029964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:47:26.030641 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:26.030620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:47:26.382636 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:26.382551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" event={"ID":"e196ebbe-ec22-4881-9b93-d53d4e4b02b7","Type":"ContainerStarted","Data":"319d1107caf71e22e0ca660a745bb118481f888941e844b5216eb9c1d0f2bdc1"} Jun 11 23:47:26.401164 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:26.401118 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" podStartSLOduration=2.939356074 podStartE2EDuration="4.401104021s" totalImagesPullingTime="182.594114ms" totalInitContainerRuntime="1.279153833s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:47:26.399914585 +0000 UTC m=+900.918081016" watchObservedRunningTime="2026-06-11 23:47:26.401104021 +0000 UTC m=+900.919270448" Jun 11 23:47:32.912161 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:32.912104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:32.912580 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:32.912244 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:32.925156 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:32.925132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:47:33.437265 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:47:33.437237 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-2f5fs" Jun 11 23:48:37.823304 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:37.823270 2581 generic.go:356] "Generic (PLEG): container finished" podID="f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a" containerID="0a6272964921b3b27a0649dc88f717f2d47064e5e6e8060b08b1f3523cf90682" exitCode=0 Jun 11 23:48:37.823723 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:37.823314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" event={"ID":"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a","Type":"ContainerDied","Data":"0a6272964921b3b27a0649dc88f717f2d47064e5e6e8060b08b1f3523cf90682"} Jun 11 23:48:37.823879 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:37.823863 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 23:48:38.831360 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:38.831316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" event={"ID":"f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a","Type":"ContainerStarted","Data":"e8634f428e9539906ea064c24cccbb684a22ff315a5d2bf48090f3d2e68f2eb4"} Jun 11 23:48:38.854241 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:38.854190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" podStartSLOduration=2.599992507 podStartE2EDuration="2m11.854176298s" totalImagesPullingTime="2.871503349s" totalInitContainerRuntime="2m6.382680442s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:46:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:48:38.850794946 +0000 UTC m=+973.368961374" watchObservedRunningTime="2026-06-11 23:48:38.854176298 +0000 UTC m=+973.372342726" Jun 11 23:48:47.611218 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:47.611187 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:48:47.611591 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:47.611252 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:48:47.623974 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:47.623950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:48:47.899419 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:48:47.899339 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dqm67" Jun 11 23:49:36.322655 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:49:36.322626 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:49:46.945848 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:49:46.945808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:49:55.620243 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:49:55.620191 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:50:06.115926 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:06.115892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:50:14.925012 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:14.924921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:50:24.817496 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:24.817462 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:50:33.152961 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.152926 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:50:33.153345 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.153174 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79b64d6b4-89t47" podUID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" containerName="manager" containerID="cri-o://bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50" gracePeriod=30 Jun 11 23:50:33.408632 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.408573 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:50:33.487529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.487497 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert\") pod \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " Jun 11 23:50:33.487712 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.487583 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvr29\" (UniqueName: \"kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29\") pod \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\" (UID: \"6c9a22e3-b8ea-472c-ada3-d5b86250489f\") " Jun 11 23:50:33.489667 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.489636 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29" (OuterVolumeSpecName: "kube-api-access-hvr29") pod "6c9a22e3-b8ea-472c-ada3-d5b86250489f" (UID: "6c9a22e3-b8ea-472c-ada3-d5b86250489f"). InnerVolumeSpecName "kube-api-access-hvr29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 23:50:33.489795 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.489741 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6c9a22e3-b8ea-472c-ada3-d5b86250489f" (UID: "6c9a22e3-b8ea-472c-ada3-d5b86250489f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 23:50:33.516672 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.516636 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" containerID="bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50" exitCode=0 Jun 11 23:50:33.516773 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.516696 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b64d6b4-89t47" Jun 11 23:50:33.516773 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.516695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-89t47" event={"ID":"6c9a22e3-b8ea-472c-ada3-d5b86250489f","Type":"ContainerDied","Data":"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50"} Jun 11 23:50:33.516845 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.516834 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b64d6b4-89t47" event={"ID":"6c9a22e3-b8ea-472c-ada3-d5b86250489f","Type":"ContainerDied","Data":"392b65ca39c8d308d4301a2f33c50c75a863571c36530f7ed92459badff188a9"} Jun 11 23:50:33.516879 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.516861 2581 scope.go:117] "RemoveContainer" containerID="bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50" Jun 11 23:50:33.526286 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.526269 2581 scope.go:117] "RemoveContainer" containerID="bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50" Jun 11 23:50:33.526539 ip-10-0-129-57 kubenswrapper[2581]: E0611 23:50:33.526520 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50\": container with ID starting with bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50 not found: ID does not exist" containerID="bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50" Jun 11 23:50:33.526590 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.526548 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50"} err="failed to get container status \"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50\": rpc error: code = NotFound desc = could not find container \"bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50\": container with ID starting with bf28ab1003708ad54c38f8f1ace1acd7b499afd37b470e9386b8c422eee6bd50 not found: ID does not exist" Jun 11 23:50:33.537854 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.537833 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:50:33.543489 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.543469 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79b64d6b4-89t47"] Jun 11 23:50:33.589190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.589168 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvr29\" (UniqueName: \"kubernetes.io/projected/6c9a22e3-b8ea-472c-ada3-d5b86250489f-kube-api-access-hvr29\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:50:33.589190 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.589191 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c9a22e3-b8ea-472c-ada3-d5b86250489f-webhook-cert\") on node \"ip-10-0-129-57.ec2.internal\" DevicePath \"\"" Jun 11 23:50:33.983317 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:33.983277 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" path="/var/lib/kubelet/pods/6c9a22e3-b8ea-472c-ada3-d5b86250489f/volumes" Jun 11 23:50:57.120938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:50:57.120902 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:51:01.830292 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:51:01.830257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:51:38.323315 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:51:38.323232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:51:53.526938 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:51:53.526904 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:52:26.071259 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:52:26.071227 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:52:26.073156 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:52:26.073135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:52:32.425423 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:52:32.425385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:52:49.028416 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:52:49.028381 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:53:03.520040 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:53:03.520005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:53:20.027483 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:53:20.027254 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:54:19.327886 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:54:19.327843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:54:28.330703 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:54:28.330667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:54:44.929406 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:54:44.929313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:54:53.429371 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:54:53.429332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:55:10.831851 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:55:10.831818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:55:19.021933 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:55:19.021896 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:55:51.730461 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:55:51.730420 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:55:59.830700 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:55:59.830667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:56:03.323100 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:56:03.323057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:56:09.719339 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:56:09.719263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:56:16.922715 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:56:16.922672 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:56:25.420504 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:56:25.420470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:56:51.021425 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:56:51.021393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:57:03.025233 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:03.025198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:57:26.117250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:26.117224 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:57:26.120920 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:26.120899 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 11 23:57:30.931034 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:30.930983 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:57:33.525137 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:33.525106 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:57:50.225250 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:50.225141 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:57:58.122221 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:57:58.122189 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:17.630701 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:17.630661 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:22.522771 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:22.522735 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:25.532425 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:25.532392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:35.021249 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:35.021216 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:44.023790 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:44.023753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:58:52.824495 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:58:52.824460 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:59:01.630774 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:59:01.630738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:59:10.523940 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:59:10.523870 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:59:19.327529 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:59:19.327492 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:59:27.325131 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:59:27.325095 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 11 23:59:35.721750 ip-10-0-129-57 kubenswrapper[2581]: I0611 23:59:35.721706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:03.344065 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:03.344018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:08.536260 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:08.536065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:26.164163 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:26.164133 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:02:26.169927 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:26.169906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:02:35.823330 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:35.823292 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:39.425244 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:39.425211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:50.228910 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:50.228876 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:02:59.822184 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:02:59.822147 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:09.434400 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:09.434360 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:19.027657 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:19.027617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:29.022913 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:29.022880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:38.722534 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:38.722449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:48.232170 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:48.232139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:03:56.916679 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:03:56.916647 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:04:06.720458 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:04:06.720417 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:04:11.431366 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:04:11.431333 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:04:39.431584 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:04:39.431549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:05:23.825075 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:05:23.824960 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:05:31.325316 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:05:31.325277 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:05:41.123299 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:05:41.123261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:05:48.846541 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:05:48.846502 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:05:58.224791 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:05:58.224743 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:09.920819 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:09.920784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:19.775780 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:19.775740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:24.325556 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:24.325518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:32.130032 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:32.129979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:39.524430 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:39.524343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:47.526325 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:47.526281 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:06:58.021602 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:06:58.021565 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:07:17.129985 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:17.129948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:07:24.529362 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:24.529315 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:07:26.204018 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:26.203972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:07:26.211516 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:26.211494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:07:34.423136 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:34.423099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:07:41.827201 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:07:41.827157 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:00.028034 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:00.027986 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:07.230483 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:07.230444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:17.033290 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:17.033206 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:24.522368 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:24.522327 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:34.423685 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:34.423645 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:42.018704 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:42.018667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:08:51.826942 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:08:51.826903 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:03.723355 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:03.723311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:14.632427 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:14.632390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:26.122734 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:26.122702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:35.626905 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:35.626867 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:41.524598 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:41.524517 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:49.241070 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:49.241031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:09:53.829652 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:09:53.829615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:10:08.227276 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:10:08.227239 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:10:17.022084 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:10:17.022045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:10:26.322645 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:10:26.322604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:10:32.930366 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:10:32.930331 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:10:54.020881 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:10:54.020847 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:11:06.726896 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:06.726854 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-slpwz"] Jun 12 00:11:44.771479 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:44.771446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8569bc4bf6-97p8r_a04480c8-f5cf-4257-a4b2-a7f12f7588cc/nginx/0.log" Jun 12 00:11:45.004394 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:45.004366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rhvw4_b4e98126-9d90-4a3a-9279-6a0373290ed5/manager/0.log" Jun 12 00:11:45.121385 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:45.121313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-c245r_470fd895-f9e8-4544-84b3-9ca47d3ee3ec/manager/0.log" Jun 12 00:11:45.652656 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:45.652626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hv9x5_2e7a03af-1c0b-4317-b8d2-b538e2c53f26/server/0.log" Jun 12 00:11:45.767853 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:45.767826 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-c5h67_78ea3dee-2ae6-497b-a021-885cad89217b/manager/0.log" Jun 12 00:11:46.120407 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:46.120382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-rv4w2_3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234/copy-manifests/0.log" Jun 12 00:11:46.133604 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:46.133580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-rv4w2_3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234/manager/0.log" Jun 12 00:11:47.009412 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.009375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/util/0.log" Jun 12 00:11:47.016755 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.016732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/pull/0.log" Jun 12 00:11:47.023597 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.023565 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/extract/0.log" Jun 12 00:11:47.141951 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.141924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/util/0.log" Jun 12 00:11:47.155363 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.155338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/pull/0.log" Jun 12 00:11:47.167313 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.167294 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/extract/0.log" Jun 12 00:11:47.277656 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.277581 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/util/0.log" Jun 12 00:11:47.284795 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.284774 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/pull/0.log" Jun 12 00:11:47.292768 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.292748 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/extract/0.log" Jun 12 00:11:47.408623 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.408596 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/util/0.log" Jun 12 00:11:47.419653 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.419626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/pull/0.log" Jun 12 00:11:47.427317 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:47.427293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/extract/0.log" Jun 12 00:11:48.254374 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:48.254341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-slpwz_3fbd754d-3f5f-4062-8c06-433201561e30/limitador/0.log" Jun 12 00:11:48.384084 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:48.384050 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cdln5_9c446ab6-4b77-4830-a84f-371717f1593a/manager/0.log" Jun 12 00:11:48.861644 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:48.861611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bgttw_cefba884-fa3d-4d81-a62c-ef19ec9396c6/discovery/0.log" Jun 12 00:11:48.977365 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:48.977337 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78ddc77f7c-fpkjb_ba7eb992-d843-431d-b387-4ed0210714a4/kube-auth-proxy/0.log" Jun 12 00:11:49.336399 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:49.336368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4nfxn_7e561f0c-2e50-4e68-b1ab-48f1fc2076e2/payload-pre-processing/0.log" Jun 12 00:11:49.456915 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:49.456888 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8ldfw_6483fefd-decb-406d-b9dc-9055c5ff202f/payload-processing/0.log" Jun 12 00:11:49.574936 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:49.574908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856f48bc96-bvjfl_c425350e-c021-45e0-bd1b-f98842ca9fc1/router/0.log" Jun 12 00:11:50.049519 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.049493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dqm67_f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a/storage-initializer/0.log" Jun 12 00:11:50.057370 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.057347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dqm67_f0bbb3fe-7615-4a1f-8bd5-c732a2eb456a/main/0.log" Jun 12 00:11:50.171295 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.171269 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l_517e4ccd-56bf-4a5a-829c-b4d209377cf9/storage-initializer/0.log" Jun 12 00:11:50.179354 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.179331 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-tm52l_517e4ccd-56bf-4a5a-829c-b4d209377cf9/main/0.log" Jun 12 00:11:50.539477 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.539452 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-2f5fs_e196ebbe-ec22-4881-9b93-d53d4e4b02b7/storage-initializer/0.log" Jun 12 00:11:50.547537 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:50.547515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-2f5fs_e196ebbe-ec22-4881-9b93-d53d4e4b02b7/main/0.log" Jun 12 00:11:57.518746 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:57.518712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8dxmb_a989c7a8-9435-4d21-ae43-65ddc247ea13/global-pull-secret-syncer/0.log" Jun 12 00:11:57.691074 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:57.691041 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzdh5_4af38d7d-27be-44d5-ab3f-49e844cca6e8/konnectivity-agent/0.log" Jun 12 00:11:57.711417 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:11:57.711387 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-57.ec2.internal_f356dd6ea2b82bf8308e8edc1842431d/haproxy/0.log" Jun 12 00:12:00.729123 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:00.729088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-m2dq4_80688a7e-114d-4cac-8e61-d3d4fcab4c65/sail-operator/0.log" Jun 12 00:12:02.278555 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.278468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/extract/0.log" Jun 12 00:12:02.309539 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.309512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/util/0.log" Jun 12 00:12:02.335815 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.335791 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759kcsxt_ebcf4823-854b-4100-8c3d-b5e4fb0de5e6/pull/0.log" Jun 12 00:12:02.364381 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.364353 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/extract/0.log" Jun 12 00:12:02.384546 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.384513 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/util/0.log" Jun 12 00:12:02.409063 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.409028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vqt7m_898a4e1e-1bc9-4fea-80a1-3dabd0f07f26/pull/0.log" Jun 12 00:12:02.435258 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.435236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/extract/0.log" Jun 12 00:12:02.459958 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.459927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/util/0.log" Jun 12 00:12:02.481302 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.481280 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jhhtl_52aa485a-d917-4388-865f-df01e61354ad/pull/0.log" Jun 12 00:12:02.507087 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.507064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/extract/0.log" Jun 12 00:12:02.527694 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.527668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/util/0.log" Jun 12 00:12:02.547967 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:02.547907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tx7ng_7a921431-fdb3-45d8-bf60-fcbe49e76c2c/pull/0.log" Jun 12 00:12:03.027959 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:03.027926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-slpwz_3fbd754d-3f5f-4062-8c06-433201561e30/limitador/0.log" Jun 12 00:12:03.097243 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:03.097213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cdln5_9c446ab6-4b77-4830-a84f-371717f1593a/manager/0.log" Jun 12 00:12:04.912183 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:04.912152 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-grnf6_5ce6727e-bcbc-490d-a35b-c3f33869c1d9/cluster-monitoring-operator/0.log" Jun 12 00:12:04.937197 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:04.937158 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-xkhh6_e5f11ffd-5458-4f92-a197-0566df8e1ae1/kube-state-metrics/0.log" Jun 12 00:12:04.957496 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:04.957470 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-xkhh6_e5f11ffd-5458-4f92-a197-0566df8e1ae1/kube-rbac-proxy-main/0.log" Jun 12 00:12:04.979862 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:04.979838 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-xkhh6_e5f11ffd-5458-4f92-a197-0566df8e1ae1/kube-rbac-proxy-self/0.log" Jun 12 00:12:05.243553 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.243520 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hm9lk_61805558-78b4-4aad-9e6e-ed8b6f743788/node-exporter/0.log" Jun 12 00:12:05.264922 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.264897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hm9lk_61805558-78b4-4aad-9e6e-ed8b6f743788/kube-rbac-proxy/0.log" Jun 12 00:12:05.286263 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.286243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hm9lk_61805558-78b4-4aad-9e6e-ed8b6f743788/init-textfile/0.log" Jun 12 00:12:05.321211 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.321190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72mjt_37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15/kube-rbac-proxy-main/0.log" Jun 12 00:12:05.351646 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.351626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72mjt_37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15/kube-rbac-proxy-self/0.log" Jun 12 00:12:05.382388 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.382362 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72mjt_37a6de7c-dc42-4f1d-bb8a-f3a33fd4ca15/openshift-state-metrics/0.log" Jun 12 00:12:05.743694 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.743666 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-j75ll_8c4cb332-cca0-4d60-ae3f-bba7916040d0/prometheus-operator-admission-webhook/0.log" Jun 12 00:12:05.777466 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.777407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8c566d68-kzxfp_bf59e35e-54d0-44e9-896c-2baa0229dcfc/telemeter-client/0.log" Jun 12 00:12:05.801900 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.801875 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8c566d68-kzxfp_bf59e35e-54d0-44e9-896c-2baa0229dcfc/reload/0.log" Jun 12 00:12:05.826216 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:05.826193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c8c566d68-kzxfp_bf59e35e-54d0-44e9-896c-2baa0229dcfc/kube-rbac-proxy/0.log" Jun 12 00:12:07.352049 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:07.351981 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-278fh_b651bde6-1af0-4378-8a7e-502ac03c1952/networking-console-plugin/0.log" Jun 12 00:12:08.604361 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:08.604331 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5899dcdb5d-ww4vj_b2c7536f-3313-4746-bc79-54c9dbcf29ed/console/0.log" Jun 12 00:12:09.921392 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.921356 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh"] Jun 12 00:12:09.921833 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.921819 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" containerName="manager" Jun 12 00:12:09.921833 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.921834 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" containerName="manager" Jun 12 00:12:09.921909 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.921903 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9a22e3-b8ea-472c-ada3-d5b86250489f" containerName="manager" Jun 12 00:12:09.925097 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.925077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:09.928533 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.928502 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wlr6r\"/\"default-dockercfg-mldf6\"" Jun 12 00:12:09.928649 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.928503 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlr6r\"/\"kube-root-ca.crt\"" Jun 12 00:12:09.928649 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.928502 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlr6r\"/\"openshift-service-ca.crt\"" Jun 12 00:12:09.936670 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:09.936641 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh"] Jun 12 00:12:10.021612 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.021581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-podres\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.021612 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.021618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-lib-modules\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.021827 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.021685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-proc\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.021827 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.021714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxzdp\" (UniqueName: \"kubernetes.io/projected/994f978d-3f19-43c3-9d37-baee0802207d-kube-api-access-vxzdp\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.021827 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.021768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-sys\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123126 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxzdp\" (UniqueName: \"kubernetes.io/projected/994f978d-3f19-43c3-9d37-baee0802207d-kube-api-access-vxzdp\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123304 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-sys\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123304 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-podres\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123304 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-lib-modules\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123304 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-proc\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123487 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123299 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-sys\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123487 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123325 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-proc\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123487 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-podres\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.123487 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.123378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/994f978d-3f19-43c3-9d37-baee0802207d-lib-modules\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.130794 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.130772 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxzdp\" (UniqueName: \"kubernetes.io/projected/994f978d-3f19-43c3-9d37-baee0802207d-kube-api-access-vxzdp\") pod \"perf-node-gather-daemonset-546kh\" (UID: \"994f978d-3f19-43c3-9d37-baee0802207d\") " pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.236889 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.236786 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:10.402578 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.402548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh"] Jun 12 00:12:10.403314 ip-10-0-129-57 kubenswrapper[2581]: W0612 00:12:10.403286 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod994f978d_3f19_43c3_9d37_baee0802207d.slice/crio-82825a77ae158b23649da6da2b1e0fe7d07344254e87e8aac1947bffa0b5e5c5 WatchSource:0}: Error finding container 82825a77ae158b23649da6da2b1e0fe7d07344254e87e8aac1947bffa0b5e5c5: Status 404 returned error can't find the container with id 82825a77ae158b23649da6da2b1e0fe7d07344254e87e8aac1947bffa0b5e5c5 Jun 12 00:12:10.732020 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.731967 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxggh_733fcfd5-13a6-4d08-9d1c-f9c37004bb83/dns/0.log" Jun 12 00:12:10.753939 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.753911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sxggh_733fcfd5-13a6-4d08-9d1c-f9c37004bb83/kube-rbac-proxy/0.log" Jun 12 00:12:10.878985 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:10.878906 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lc6mf_4407d7ce-2aa6-42f1-a78b-fd9b53df679f/dns-node-resolver/0.log" Jun 12 00:12:11.328186 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.328150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" event={"ID":"994f978d-3f19-43c3-9d37-baee0802207d","Type":"ContainerStarted","Data":"3f63c717fcb00e534f54ad6d0e5df47f326d67d14b3a6bf4c61193b6fea0b516"} Jun 12 00:12:11.328631 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.328200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" event={"ID":"994f978d-3f19-43c3-9d37-baee0802207d","Type":"ContainerStarted","Data":"82825a77ae158b23649da6da2b1e0fe7d07344254e87e8aac1947bffa0b5e5c5"} Jun 12 00:12:11.328631 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.328230 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:11.352274 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.352225 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" podStartSLOduration=2.352209224 podStartE2EDuration="2.352209224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 00:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:12:11.350066608 +0000 UTC m=+2385.868233037" watchObservedRunningTime="2026-06-12 00:12:11.352209224 +0000 UTC m=+2385.870375686" Jun 12 00:12:11.516610 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.516582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8454c7b78-87s58_dd1399bf-05af-484f-ab2f-35b77b9926c2/registry/0.log" Jun 12 00:12:11.524259 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.524225 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8454c7b78-87s58_dd1399bf-05af-484f-ab2f-35b77b9926c2/registry/1.log" Jun 12 00:12:11.545108 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:11.545073 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28dsp_3b8a620d-ac03-4c6a-b58f-cbd5a15a4d2b/node-ca/0.log" Jun 12 00:12:12.609429 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:12.609392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bgttw_cefba884-fa3d-4d81-a62c-ef19ec9396c6/discovery/0.log" Jun 12 00:12:12.629451 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:12.629423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78ddc77f7c-fpkjb_ba7eb992-d843-431d-b387-4ed0210714a4/kube-auth-proxy/0.log" Jun 12 00:12:12.742051 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:12.742017 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4nfxn_7e561f0c-2e50-4e68-b1ab-48f1fc2076e2/payload-pre-processing/0.log" Jun 12 00:12:12.799502 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:12.799470 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8ldfw_6483fefd-decb-406d-b9dc-9055c5ff202f/payload-processing/0.log" Jun 12 00:12:12.825787 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:12.825749 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856f48bc96-bvjfl_c425350e-c021-45e0-bd1b-f98842ca9fc1/router/0.log" Jun 12 00:12:13.455061 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:13.455033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r64d4_52450da7-4a50-4ff6-b45d-6dce16bbfbaa/serve-healthcheck-canary/0.log" Jun 12 00:12:13.992337 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:13.992305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-c6vf8_1907afdf-750a-477e-8c00-65786f27783c/insights-operator/0.log" Jun 12 00:12:13.993959 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:13.993927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-c6vf8_1907afdf-750a-477e-8c00-65786f27783c/insights-operator/1.log" Jun 12 00:12:14.107239 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:14.107210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brq4c_5e33dfec-1568-47ea-9964-ed03b387a180/kube-rbac-proxy/0.log" Jun 12 00:12:14.138022 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:14.137974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brq4c_5e33dfec-1568-47ea-9964-ed03b387a180/exporter/0.log" Jun 12 00:12:14.161613 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:14.161589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brq4c_5e33dfec-1568-47ea-9964-ed03b387a180/extractor/0.log" Jun 12 00:12:16.446679 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:16.446646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8569bc4bf6-97p8r_a04480c8-f5cf-4257-a4b2-a7f12f7588cc/nginx/0.log" Jun 12 00:12:16.506979 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:16.506943 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rhvw4_b4e98126-9d90-4a3a-9279-6a0373290ed5/manager/0.log" Jun 12 00:12:16.603427 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:16.603398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-c245r_470fd895-f9e8-4544-84b3-9ca47d3ee3ec/manager/0.log" Jun 12 00:12:16.813241 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:16.813157 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hv9x5_2e7a03af-1c0b-4317-b8d2-b538e2c53f26/server/0.log" Jun 12 00:12:16.861671 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:16.861640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-c5h67_78ea3dee-2ae6-497b-a021-885cad89217b/manager/0.log" Jun 12 00:12:17.045793 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:17.045742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-rv4w2_3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234/manager/0.log" Jun 12 00:12:17.067223 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:17.067135 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585bb5b6dc-rv4w2_3de6c973-f7c8-4d3e-9c47-2c3a2e7fc234/copy-manifests/0.log" Jun 12 00:12:17.345336 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:17.345266 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wlr6r/perf-node-gather-daemonset-546kh" Jun 12 00:12:18.724328 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:18.724293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qnz7d_a741f366-f2e1-4db2-a113-aaf23f4799eb/openshift-lws-operator/0.log" Jun 12 00:12:23.343247 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:23.343217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bgttw_cefba884-fa3d-4d81-a62c-ef19ec9396c6/discovery/0.log" Jun 12 00:12:23.353143 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:23.353122 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78ddc77f7c-fpkjb_ba7eb992-d843-431d-b387-4ed0210714a4/kube-auth-proxy/0.log" Jun 12 00:12:23.459320 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:23.459296 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4nfxn_7e561f0c-2e50-4e68-b1ab-48f1fc2076e2/payload-pre-processing/0.log" Jun 12 00:12:23.509945 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:23.509920 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8ldfw_6483fefd-decb-406d-b9dc-9055c5ff202f/payload-processing/0.log" Jun 12 00:12:23.522650 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:23.522620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856f48bc96-bvjfl_c425350e-c021-45e0-bd1b-f98842ca9fc1/router/0.log" Jun 12 00:12:24.799348 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.799320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-82dwg_1a38ace0-cef8-4e0a-8f4d-031393d6366c/kube-storage-version-migrator-operator/1.log" Jun 12 00:12:24.800568 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.800545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-82dwg_1a38ace0-cef8-4e0a-8f4d-031393d6366c/kube-storage-version-migrator-operator/0.log" Jun 12 00:12:24.802611 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.802592 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bgttw_cefba884-fa3d-4d81-a62c-ef19ec9396c6/discovery/0.log" Jun 12 00:12:24.819175 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.819158 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78ddc77f7c-fpkjb_ba7eb992-d843-431d-b387-4ed0210714a4/kube-auth-proxy/0.log" Jun 12 00:12:24.943461 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.943427 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4nfxn_7e561f0c-2e50-4e68-b1ab-48f1fc2076e2/payload-pre-processing/0.log" Jun 12 00:12:24.999585 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:24.999553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8ldfw_6483fefd-decb-406d-b9dc-9055c5ff202f/payload-processing/0.log" Jun 12 00:12:25.022665 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:25.022630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856f48bc96-bvjfl_c425350e-c021-45e0-bd1b-f98842ca9fc1/router/0.log" Jun 12 00:12:26.025290 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.025266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/kube-multus-additional-cni-plugins/0.log" Jun 12 00:12:26.050970 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.050940 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/egress-router-binary-copy/0.log" Jun 12 00:12:26.072958 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.072929 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/cni-plugins/0.log" Jun 12 00:12:26.093162 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.093138 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/bond-cni-plugin/0.log" Jun 12 00:12:26.114784 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.114758 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/routeoverride-cni/0.log" Jun 12 00:12:26.135638 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.135607 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/whereabouts-cni-bincopy/0.log" Jun 12 00:12:26.155184 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.155161 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlr25_65bdc258-8964-4843-be10-4215f970ae4f/whereabouts-cni/0.log" Jun 12 00:12:26.245551 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.245522 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:12:26.254658 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.254637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcddd_0f795df2-f0c8-475f-bf8a-6077d310a6d6/ovn-acl-logging/0.log" Jun 12 00:12:26.558624 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.558598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dhl2k_59713dcc-1c3b-44c0-ad1f-037e1b9a1679/kube-multus/0.log" Jun 12 00:12:26.683028 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.682980 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wz62w_34d0819d-d6a5-4fb6-ad42-bcfafd7928da/network-metrics-daemon/0.log" Jun 12 00:12:26.701938 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.701908 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wz62w_34d0819d-d6a5-4fb6-ad42-bcfafd7928da/kube-rbac-proxy/0.log" Jun 12 00:12:26.747868 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.747832 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-bgttw_cefba884-fa3d-4d81-a62c-ef19ec9396c6/discovery/0.log" Jun 12 00:12:26.759638 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.759614 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78ddc77f7c-fpkjb_ba7eb992-d843-431d-b387-4ed0210714a4/kube-auth-proxy/0.log" Jun 12 00:12:26.846883 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.846803 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4nfxn_7e561f0c-2e50-4e68-b1ab-48f1fc2076e2/payload-pre-processing/0.log" Jun 12 00:12:26.893307 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.893271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-8ldfw_6483fefd-decb-406d-b9dc-9055c5ff202f/payload-processing/0.log" Jun 12 00:12:26.905722 ip-10-0-129-57 kubenswrapper[2581]: I0612 00:12:26.905692 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856f48bc96-bvjfl_c425350e-c021-45e0-bd1b-f98842ca9fc1/router/0.log"